Do you really think that shoes should be allowed to be kept on just because you are in fast track? You do realise its for security and not just to slow you dowN? What difference does the time make anyway, it will probably add 1-2 minute of "lounge time" which, lets face it, is just a glorified waiting room and I usually arrive as late as possible to avoid being there.
Sorry if I am missing something, I only ever use fast track so haven't been in the normal lane (apart from places where there is no option) for a while.