On BA I have only been asked if I speak English once.
The other passengers in the exit row were white, and they were not asked.
Two of the other passengers didn't speak English particularly well (as evidenced by their later conversation with the FAs during BOB) and nodded blankly at the exit row briefing. They also left their bags under the seat in front during takeoff and landing, despite being told to move them.