Well I completely removed Diary and it was still doing it.
Then I removed Skype, and so far, I've been without problems. <Knock on wood>
This was the version of Skype that came with the latest i-mate ROM, and I'd heard there were problems with it. Hopefully I can find a version that'll work. Or, I may look at overclocking the thing and then reinstalling Skype. The potential for wifi calling when I'm overseas is one of the things that made me get this little sucker.