If by "non computer" you mean a machine that doesn't run on XP or Vista then the Foleo was indeed your only real option. The Asus EEE pc is coming to stores soon, it'll be a very compact $299 machine but it's a "real" PC.
The 3Com Audrey was meant to do all these things, but was not compact, and only made it to stores for a few months before being canned...