Can you go to the lounge first? - yes, Outbound and inbound traffic is mixed therefore nothing to stop you from going to a departure lounge then afterwards clearing immigration to exit. Which lounge though? The Serendib is decent. Serendiva less so. The other third party ones like the aaraliya aren't very good at all.
7 hours ? plenty - the new highway to town makes things even smoother.