Atlantic City is a dive and I'm not sure what there is in New Haven except for Yale.
I'll second the suggestion of going to Boston. You can take the train, fly, or take one of the cheap buses like Bolt or Megabus. You don't need a car in Boston and it's a great city. Transportation to/from the city is EASY.