Public transportation from JFK to LGA is possible, using the subway and buses. Per-person cost would be $1.50 with a Metrocard. However, if you're not familiar with how to do it, you shouldn't even try. It's complicated, and the consequences of getting lost (missing your flight) are serious enough to not take the risk. If you really want the details, please e-mail me.
Bruce