Cross-continental options have taken a big hit on Southwest with the consolidations last year. Combine that with the fact that Southwest doesn't do red-eyes and there aren't many choices.

In your case, it seems to me like it would be easier to drive to BOS and get another airline non-stop from there. You have to drive more but it's probably less time than you would spend on a layover from PVD.