The boat is much more fun. Haven't done it for a while but most of the cheap boats stop/transfer at Koh Phi Phi. It will take longer than the bus but not that much longer. The bus goes roundabout while the boat goes in a relatively straight line. A taxi for 2500 baht seems too low to me, but again, I haven't done it in a while.