For me, the journey to both airports is indeed pretty much equal (and also similar to LTN and STN; only LCY is a bit quicker). So when flying BA, it largely comes down to lounges. My preferences are therefore LHR T3 > LGW > LHR T5.

If flying other airlines/terminals then other factors come into play but keeping this to the BA question.