I was travelling in Y last year and I was asked very politely by the FA, to allow a couple with a child to sit together. Because I was very nice about it the FA then came back and moved me up to WT+. Not an aisle but I was happy with the move.
Settling down in WT+ another couple wanted to move around to sit togetehr witha baby so I did it again and ended up at the front bulkhead of WT+ in an aisle seat. Result!
Moral of the story is.. what goes around comes around. Do not bow to bullies, but help those in genuine need and you will be repaid.