There's no reason that that should be happening.

Is it possible that your mouse is very sensitive to clicks and you are accidentally clicking?

I only ask because that happens to me occasionally.