PNH is a rather dusty, chaotic city. It reminds me a bit of the scene of Vietnam city scenes in Full Metal Jacket. It is interesting to say the least, but I didn't find it that enjoyable.

You could probably find a fairly cheap fare direct to the area of Angkor Wat from Bangkok. I'd guess in the $200 area, but haven't checked recently.