I do the same as rfrost. If there's light traffic and I'm driving from LGA/JFK into Manhattan or vice versa, I'll always take the bridge to save the $4.50. If the bridge is backed up, my time is worth more than $4.50 so I'll spring for the tunnel.
Radio traffic reports are one's best friend in situations like these.