This is what I've come up with so far:
Leave LA on Sunday morning and drive to Death Valley. Spend a few hours there and then drive back to Bakersfield and spend the night there. I found a Marriott for $120 in Bakersfield.
Next day drive from Bakersfield to Monterey and might take the PCH.
From Monterey we will get to SF on Tuesday as it's only a few hours drive.
We will have an additional night in SF before flying out on Wednesday.
Of course this all might change between now and Friday.
Thanks