I used to be a timid and shy guy, but a few years ago I finally spoke up when someone was being completely ignorant of the people around him.
I'm not belligerent nor do I try and make a scene, but I do let the person offering the offending behavior know "I'm not amused."
Now my friends know me as being grumpy....but they're always well behaved when I'm around!