you know what's more comfortable for sleeping than 3 Y seats for 2 people ? 2 J seats for 2 people. Seems a wise use of your SWUs since you have a hard time using them all anyway.
Assuming your SWU cleared, I'm sure you'd have no trouble convincing the aisle person to move forward.