Depending on your preferences, you may very well want to visit the Camargue National Park which is south of Avignon. Lots to see and some striking towns nearby:
A remarkably preserved Romanesque facade in St. Gilles.
The now land locked historic town/port of Aigues Mortes
Now we're edging into Languedoc-Roussillon, granted.
In the other direction, I second the idea of a night in St. Agnes but it's a bit difficult, the twisting somewhat narrow road up to the highest coastal village in Europe.
"The one thing that saves Sainte Agnes from being overrun [with tourists] is that it's not easy to get to; only 4 km from the coast as the eagle flies, it's about 12 km of narrow and twisty mountain roads by car, above Menton at the eastern end of the French Riviera."
We arrived very late, in a heavy rain, found a place to have dinner and borrowed a market umbrella (HUGE!) to make it back to our room. In the light of the next morning, it did seem a little touristy for such a small, obscure town. There weren't many tourists there but quite a few stores catering to the daytrippers.

Just a warning: St. Gilles is an impoverished town (at least when I was there a while ago) and seemed to be a town where the Govt placed a lot of new immigrants. No problems but there were NO tourists there.