How do bugs get in the windowsill?
The windows do not form a perfect seal. The pressure for a seal required at 35000 feet is different than at ground.
In very very very cold temperatures, it's possible for deicing fluid to enter a plane window. I could see that a bug could get in in certain conditions.