unless you're flying first class or in the first boarding group, always be prepared to gate check a large bag. If something in the bag was fragile or valuable, you could have taken it out.
Yes, you were in the wrong here. Tragedy of the commons, if everyone acted like you, no plane would ever leave and the Gate Agents would have to adjudicate who had the best reason why their luggage was to important to check.