I would have pointed out that I only have one bag in the overhead (which sounds like is the case for you; otherwise you don't have a really strong case) and thus feel like the bag should stay where it is.

I'm sure they thought it was someone's second bag (though I don't see why the other person's second bag is any different than yours).