Long ago I used to see upgrade options at the kiosk, or even when asking agents. But that's more than 10 years ago now.
It seems the online/app upgrades are by far the most value, and they try to book upgrades this way, well in advance. Even when there are still seats open, I think the airlines assume that last-minute requests will be willing to pay more, and price accordingly now.