Definitely play tourist
Either Frankfurt or Mainz are easily accessible, and there is plenty to see in both places.
In Frankfurt, get off at the "Hauptwache" subway stop, which will put you in the center of town, then take a 10-minute walk to the "Roemer", the old Roman remains, cross the pedestrian bridge over the river to Sachsenhausen and enjoy the view.