From the USA you will arrive at UVF, so you will inevitably have the long drive to your destination. On the positive side, the roads are remarkably well maintained (if winding!).
As I assume you are an independent traveller (i.e. not on a package trip) your ground transfer solution lies in exploring the Internet. All our trips (ex UK) were through British Airways Holidays, with the ground transfers included, sonI can offer no personal guidance.
PS. My 2019 Trip Report is here >>>
The Caribbean [again] with BA in Club World.