That has always been true (different countries have rules about entry based on visit to certain areas with Yellow Fever, for example). And it will obviously be part of the equation this time.

But I think that the biggest problem is that we don't yet know enough to even predict the difference. Here are a few of what I suspect are the major issues:
1. What level of immunity is provided by exposure?
2. Does having only a mild case mean that you will only have a mild case next time? Or does it mean that you will have a worse case next time?
3. How many people have been exposed? (i.e. - how close are we to herd immunity, if that even exists)
4. What is the actual chance of catching the disease from touching a surface that someone else touched, versus being too close when they cough?
5. What are the long-term health consequences of being sick? (i.e. - is there really a 25% chance of long-term significant health deficit?)
6. What is the chance that if you get on an airplane, and go to another city (or another country), you will not be allowed to return? Or, if you are allowed to return, you will be subject to a "real" 14-day quarantine?

The answer to those questions, NONE of which are yet known, will help to set the "mood" of the public.