Yeah, plan roughly an hour each way to get anywhere useful in Manhattan.
And if this is on a weekend, the train schedule can have big gaps, so you might want/need to take a car in.

Maybe it would be worth going to Rockefeller Plaza to see the Christmas tree (I *think* it's still up on the 26th!) and the windows at Saks Fifth Avenue.