That's why most airlines pad their schedules - because most people care primarily about when they arrive. (Also, of course, to minimize missed connections.)
OP, you said that it did matter to you but you didn't explain why. I would be curious to know your thinking about this - it is an interesting question you raise.