I live in Southern Oregon -- somewhat colder than the Bay Area -- and we have scorpions all over here. I seem to find them in our shoe closet every other week or so. They are not particularly harmful -- about like a bee sting.
Edit: now I'm remembering I once saw one while hiking on the "Dish" near Stanford. Saw a tarantula too, which was cool.