I do this all the time. If I do need to book a middle, btw, I always book myself there in the event we clear one upgrade and not both. Then at least I'm in an aisle of window while the mrs. is up front.
But when we travel alone in Y, I almost always book window/aisle. I've never had anyone refuse to switch, and 99%+ they're absolutely giddy when we offer. The caveat would be a trans-con where I might book aisle/aisle adjacent to each other. You can still chat, though you're mostly watching a movie or utilizing IFE in some way.