Battery Park
Battery Park is pretty far away from all NYC attractions with the exception of the Statue of Liberty, Ellis Island, Wall Street, and (if it is really an attraction) Ground Zero.
Property is upto Ritz standards, with incredible views, great service, and nice rooms. Just realize that a Taxi to midtown will be $20 or more.