Lavender should be able to well depending the type you go for. There are lavender grown in Sonoma County; I am unsure if you live further north than but lavender also thrives in Ontario which is a province known for hot summers and harsh winters.
I learned that there is 39 species of lavender maybe one of them would work for your location. I ask my nursery lots of questions. Maybe if you have a local one they could be a good source for you to chat with.
Thanks! Your answer is awaiting moderation.