Agree on the Hampton (Downtown on Fifth Ave) and it's close to a nice McMenamins Pub walking distance (shallow I know). Upgraded every time and cheap taxi ride to the piers and downtown. A bit of a walk though if hitting for work the financial area. If that's the case Homewood is nice. I've never stayed at the downtown Hilton.

If you want easy access to downtown proper by walking, financial area, market, and the piers, stay at the Homewood. Otherwise you're going to taxi alot.