Hvar town is definitely set up as a party place for tourists and a parking lot for mega-yachts. However, just down the road from Hvar is Stari Grad, which I found to be an incredibly charming old town that is nice to walk around and largely devoid of tourists/tourist traps. Stari Grad is also served by ferries, with easy access to/from Split. There are some other beaches and vineyards on Hvar island as well, so I would not dismiss the whole island on account of one neighborhood in one town.

I did have the pleasure of visiting DBV last summer, and it was absolutely the best possible time to visit DBV & HR, as there was no crowding at all, no cruise ships, and few tourists. There was also no traffic along the typically gridlocked HR coast between Split and Zadar, which made the whole trip quite wonderful (aside from the whole C-19 thing). I would imagine it is considerably busier this summer, but still much better than normal, given the absence of cruise ships and travel restrictions in place.