Technically you were right.

However, given the over-crowding of the lounge at times, I wish the lounge agent's understanding of the rules were what were in force (at least when the lounge is crowded).

I suspect the rules were meant for people travelling on the same flight but I suspect they failed to specify it, to be honest.