The food situation on Virgin Gorda is generally mediocre, but there a few new restaurants that have opened recently that have improved the situation. CocoMaya is a very good Japanese/Latin American fusion restaurant and there is a good barbeque place now as well (Hog Heaven).
I couldn't imagine going to VG and not renting a car.