Would consider one of the hotels in Japantown/Fillmore area
Lots of restaurants for breakfast, brunch, lunch, coffee, dinner
Lots of places to have a drink
Great quirky Japanese stores.
Walk down Fillmore towards the bay. There is a great park close to the water and you can walk back up.
Great views and great work out.