Ultimately you can get to an "airport" which is just space for a plane to land. Torres Islands airport in Vanuatu would be my smallest one - it's a grassy field with a wooden shack and a bench. No fuelling, etc. I've been to a few which are almost that small, but not quite as much of nothing.