The normal position at LHR is that if you do not have a boarding pass for a flight departing from a particular terminal that day, you will not be able to get access to the airside departures area in that terminal, and thus cannot use any lounge in that area (including the QR lounge at T4).