Even when the passport control queues have been very long I have never seen the security queues behind it been that big. I'm talking about the non-fast track area here.
However, in the old arrangement security was an absolute nightmare at the end of the concourse as everyone who had been shopping and eating all arrived at the same time for the many flights leaving at once.
Keep security where it is in my opinion, I like to know once I am in the lounge that I simply walk to the gate and don't have to factor in a security check.