SSD, without a doubt.

I would read reviews carefully of budget laptops - an putting an SSD in one might reveal that it has a terrible processor that basically can't handle anything, for example (whereas the laptop $30 more might be much better).

If you are somewhat tech savvy or good with hardware, you can always buy a laptop with HDD then buy an SSD and the equipment to copy everything (a 500gb SSD with that should be under $90).