Mainz is an interesting town for a day. If you are flying back out of FRA, you may want to stop there on the way back.
If you have a car, it can be a great drive along the river. I did it from Mainz to Bonn. Scenic and a couple cool little towns.
Not sure if headed south is as scenic.
I would second Heidelberg and the castle there.