Doesn't exactly sound like a rule but a desk agent being helpful? Surely they're under no obligation to check your hand baggage in for free if you've packed something knowing it can only go in the hold?
The only 'rule' (if I could call it that) is the occasional offer to check hand baggage for free when the flight is going to be very busy and they're expecting to run out of space in the cabin.