I think the worst times at LGA (arriving and departing) are probably Monday mornings, and Thurs/Fri/Sun afternoon and evenings. I would definitely avoid LGA around then.

Theres a thread in the NYC forum with more discussion about the buses to taxis and general traffic conditions.