I have faced this same scenario, and took the same path. I explained that I preferred the aisle and not a bulkhead, and suggested they should ask the other bulkhead person. Had that person declined, I likely would have switched since the couple was nice about it when they asked me.