Renting a car is a must i.e. Charlottetown is boring. Did you specify timing? If not, July/August are busy on PEI, otherwise its a ghost province.
My PF is Souris, where you can catch a ferry to Iles de la Madeleine, Quebec.