I had pretty much the same.
It can be a wrong size ear foam or gel.
What I ended up doing is ordering the Triple Flanged ear rubbers off the Shure website, and using them for my e2C's. Even though they are not made for the e2's they fit just fine (after cutting a tiny bit off the end of them).