I noticed this as well on my last flight, but what I noticed was that when the IFE was turned off the controls for the reading lights were frozen.
i.e if the light was on, it was on and you couldn't turn it off - and vice versa
maybe its not so much that they turn off the IFE but that they lock the controls?