I second the concerns about rooms at the Empress, and I also second the Ocean Pointe (which has a view of the Parliament Buildings AND the Empress - 2 for 1!).

Do walk through the lobby of the Empress.
Do stop for a drink in the Bengal Lounge.
Do NOT go there for afternoon tea (overpriced tourist thing).