I remember that in my case it was only the security guard (who pre-checks your BP before allowing you to proceed to passport control) who noticed this and reminded me that my flight is from a "different" terminal. I mentioned that I am aware of this and that I am going airside here because I'm with a friend who is departing earlier than me, after which I will proceed to my own gate. Guy just waved me through.