Whether you can turn a job down purely based on the travel policy surely depends on your current and prospective future employment status. If your in a good job that you enjoy then maybe you can be picky about travel policy but if you’ve got a choice of that job or nothing then it’s not much of a choice.
personally I would turn it down unless it was that or nothing, or they’d let me pay the fare difference at booking stage.