An easy way around the keyloggers is not to use the keyboard for passwords on public computers, pop up the onscreen keyboard to enter passwords, and normal keyloggers will not capture that (it's under Accessories, Accessibility).

It's not going to eliminate all problems but it's making it just a bit harder to capture your information.