If everyone took their whole family into the lounge, it will get filled up very quickly. The food would go very quickly and the service times increased. The rules are there to help everyone, not the few. Otherwise it will end up like a public lounge.