We notice this on majority long haul flights. Not on shorthaul. Maybe because shorthaul there is not much time for service anyhow.

Last week was kind of strange with me in D seat, my young son in E and my wife in F (CW). I got all the welcome etc and when drinks were served they walked past my wife. I thought maybe they would come back but they didn't. The drink service was still on my side so I asked a glass of water for my wife. The response was that "I am not allowed to pass a glass over seat E to seat F" and she turned away to continue her service. I called her back and asked a glass of water for me and handed this directly to my wife.

Appreciate this specific example probably has little to do with gender but generally speaking I get better service when traveling together.