The place I see the most potential for an issue is the taxi from the waterfront promenade in Tsim Sha Tsui to Kowloon Station. I'm sure one of the HK forum regulars that's in HK right now can provide some more in depth information but I would keep in mind that there's some major construction going on near Kowloon Station for the future terminal of the high speed rail line to connect Guangzhou & Hong Kong. Last time I did a quick exit out of the airport, it was the taxi to and from Kowloon Station that sucked up a lot more time than I had anticipated.

However, I agree that you should have enough time to do what you want to do.