Provence covers 6 departments. A vast area. For me, Provence is the back country, the rural areas, stopping at little wineries to taste in the middle of the countryside, discovering little restaurants in tiny towns.
Impossible to do without a car!
Bicycle will certainly narrow your field, but sure, that's a swell way to see the countryside as well, as long as you are in shape to do the hilly areas.
RE: St Paul: A VERY over-touristed place, much too cutesy for my taste. Better, go to the larger and real town of Vence, with real people and a real environment.
What are your preferred activities for Provence?