The best way to beat the "high" cost of AirTrain Newark is to take the #62 New Jersey Transit bus from Newark International Airport to Newark Penn Station ($1.00). From Newark Penn Station, you can catch a PATH train to Manhattan for $1.50.

I wouldn't recommend this at rush hour, as the traffic can be really bad from the airport to Newark Penn Station.