I always thought it was okay to leave the headphones on and leave them plugged in. I have had a FA ask if my ipod was off, and then look at it to inspect (that was annoying) but other than that the FAs leave me alone.