Out of courtesy, I don't plug my Shures into anything until it is time. They have a very short cord to the actual ear buds so it's obvious it's not plugged into anything.

I'm sure pretty much everyone says "Yes, it's turned off" when in reality many have it on. I've also sat next to plenty of people listening to music during takeoff and landing and the FA didn't say anything to them at all.