you might want to priceline a rent a car fr the 6 or so hours. Otherwise it'd be difficult on public transport.
For Fishermans Wharf, assuming BART is running, take BART to Embarcadero station and then the F historic Streetcar.
www.511.org
will help you plan a public transit trip