People sometimes complain about this, saying that the outside air is leaking in. This is a bit off-topic, but how does the air leak in when the cabin is at a higher pressure than the outside? Kind of the same way that air doesn't leak into a balloon.
I would guess that it's just a problem with the insulation in the door.