FWIW, you did exactly what I would have done. The captain's comment is quite peculiar, because not only is the situation not entirely safe, it's not peculiarly comfortable, either.
I suppose I would have relented if someone (preferably, one of those who think that a broken seat is not a big deal) offered to switch with me so that I wouldn't have to deal with it.
