My primary issue with being asked to switch seats is if it is similar or better, but even then I would pause since my CC is connected to my assigned seat.

These days I am more likely to say no unless the GA is involved and my CC is mapped to my new seat.