Indeed. You can also just ask at the lounge to see if they'll switch you. I'd ask at each step along the way (check-in, etc.). The worst they can say is no, though certainly it is officially not allowed.