You can take the New York Airport Service Bus from right outside every JFK terminal. This will then drop you off at Grand Central Terminal and then continues on to Penn Station. $15 one way, buy ticket on board bus. Takes about 45 mins.

Having recently negociated the NYC subway, I would hate to be doing it with luggage at rush hour. It may be cheaper, but there is a lot more hassle than just getting on a bus.