You cannot access the airside area of any terminal in LHR (or any UK airport I've used) without a boarding pass for a flight departing that terminal that day (or perhaps early the next day).

The one No. 1 Lounge I used (LGW S) did make mention of the time limit, but I couldn't test the theory as I arrived less than 3 hours before my flight.