Provincetown Ferry service is seasonal. This time of year there might be weekend voyages, but not during the week.

We'd rent a car and go to Newport. We lived in the Boston area for decades and Newport was our favorite day trip destination other than Cape Cod for this time of year, and definitely Newport if there was going to be wet weather