I was asked to move last week actually so that a family could sit together. I had pre-selected the aisle seat on on-line check-in and the guy in the middle seat asked if he could swap to be near his family in DEF.
I was pretty annoyed, but I thought that being stuck between a grumpy family would be worse so I moved.
Que - no arm-rests and sqashed by family's son who must have had sore balls because his legs were wide open. I waited till he started snoring before 'accidently' banging my tray table on his knee. Never again..
But how do you refuse without getting into an uncomfortable situation?