Second the boat option - I always enjoy overnight ferry crossings, and it's less than an hour and a half from Edinburgh Waverley to Newcastle, with three train companies competing for your business. Newcastle is definitely worth a stop-off, too, even if it's just to get the views down the Tyne.
Personally, if I were flying, I'd be every bit as happy with easyJet as I would with KLM.