You generally have to be a guest at the hotel to use the pool, even if you are an elite member. Some hotels have day rates for non guests, so it's worth calling the front desk to ask.

Here's a partial list of NYC hotel pools, many with the day pass cost:
http://gonyc.about.com/od/summer/a/swimming_pools.htm