There is another onsen facility closer to Narita Airport,
Hana no yu.
Actually, there is another one closer to Narita Airport at
Narita View Hotels, (onsen part of hotel website is in Japanese only) which is open to none hotel guests from 12 noon to 11:30 p.m. Where Narita View Hotels will be the closest from the airport.