The toll plaza is typically only a problem westbound from 5:30 am to around 9:30 am. The real problem is the backup through the city in either direction, which tends to be very bad these days from 2 pm to around 8 pm.

I moved to downtown Oakland recently in part so I could walk to Bart, as I'm flying in/out of SFO more or less weekly. Ridesharing service is considerably more expensive if they're forced to take the San Mateo (with the other issue being that their apps often don't identify back-ups through the city in time).