The airport facility itself and the distance from the gate to the "drop off belt" is often a factor. In larger airports, the difference can simply be how far down the concourse your arrival gate was in relation to where the driver needs to take the bags. In some cases it's a far drive. Another big factor is the airline. Some airlines have different procedures for flight offloads. I once worked for an airline that expected the local driver to stick around for the entire offload before running the local bags downstairs. Sometimes the locals bags (bags that are to be dropped on the carousel) are split front and back and that can affect offload time. Sometimes the locals are loaded behind the transfers. Sometimes a local driver is responsible to running bags from 2 flights that are down at the same time, and it takes a bit longer to round them all up before he can head downstairs to offload them. Sometimes the local driver sucks at his job.. All are factors that can affect the time it takes for your bags to appear in the baggage claim.
As far as the hows and whys of anything having to do with ramp operations, I could write a book.