Definitely go to the Ferry Building, whether or not the Farmer's Market is going on. It is gorgeous and has delicious food and the Embarcadero from there toward the baseball stadium (toward the Bay Bridge) is a great gorgeous walk on a nice day. Check out the new crazy looking rusty looking metal statues there. They are already a huge photo magnet for everyone.