I take mine on and off depending upon where I'm going.
I find the main advantage of having tags (depending upon country/culture) is not actually airline related, but upon arriving at hotel or car rental desks. Those staff are often trained to be alert to high value customers, so someone clocking your tags can lead to preferential treatment.