I'd guess that pilot use of "up, down, and across" may also come from their own experience of being in the cockpit; they end up watching the little digital radar in the cockpit for most of the flight and thereby experience the flight as a geographical experience where they literally go "across" or "down" or "up" on the map.
As for FA's, I dunno.