Never. The word no has only been entered into my vocabulary recently and when I use it I usually get a second look. In the example I probably would have said no as well. I’m fairly sure that his seat mate could have swapped with his friends seat mate.