I travelled most of Samui, including the hilly parts on a rented motorbike, so I presume a small car should be just fine. Ofcourse nothing says going local better than a muddy Toyota or Isuzu pick-up truck.