Most of the time we stay at HR, PH, but whenever we go to NYC, we actually prefer to stay at the Jersey side, simply because the drive to the city is such a pain. This is by far probably my most preferable location, it is much better than the HR at Hoboken in terms of the convenience. The train at Exchange station at Hoboken is just ridiculous: long wait, either too cold or too hot at the station depends on the season you go. Even better, more walking and dirty NYC metro to take after getting off.
I am not too crazy at the hotel itself, but nothing beats direct bus service across the street.
For the security concern:
I always bolt lock my doors whenever I stay at a hotel, and if I stay at a Hyatt place, I don't ever bring anything expensive with me.
I never eat the breakfast there as it is always crowded. I always go to NYC to have my meals.