With something like TrueCrypt, really the only one I'm familiar with, you'd just install the application on the removable media.

I believe the commercially-available thumbdrives, for example, work in a similar fashion. The encryption software automatically runs when you plug the drive in, and then a separate unencrypted volume gets mounted.