I was also there last September, and the weather was gorgeous.

I'd go - the island is beautiful, the people hospitable, and it's a unique part of Canada with a very special culture.

Also, while the weather is still decent in September, you miss the big tourist crowds. That can be good and bad - easier to find accommodation last-minute, few to no crowds, but some places may be closed or operating on a reduced schedule.