I'm pretty happy with my Maxtor USB2 HDD.
For your purposes, it actually comes with a copy of Retrospect backup, and has a button on the front that will initiate a backup without doing anything in software to kick it off.
They come in sizes from 80-250GB.