Well, this is very weird.
It simply suddenly stopped working.
For months and months I had had it connected this way
Modem ---> Router ---> Ooma box (so I could manually adjust the QoS in the router)
So I switched it to Modem ---> Ooma ---> Router and all is well again.
No idea why the former configuration would stop working out of the blue.