The problem is that at Terminal 4, arriving and departing passengers are moving around on different levels. Once you get into the airside departures area (where the Terraces lounge is) you have to be escorted out by staff. It has been suggested that this isn't a massive issue but it's clearly harder to do at T4 than at the other terminals where you can navigate your way to the other side without staff intervention.