It may take longer Jordan/Israel than the other way around. In any event, it's time of day that will make or break the crossing. We crossed from Jordan to Israel at 5:00 (1700). Took a couple of minutes. I was told that if you arrive a couple of hours later, when all the Petra day-trippers return to Eilat, it will take longer.