You would be amazed (or in some cases horrified) by the number of people who have access to your room during the day, maids/housekeeping, managers at all levels, maintenance, contractors, etc. Could be dozens. If you can live with them, you shouldn't have a problem with the one who accidentally opens the door and leaves a few seconds later.

If something is missing, report it. If not, have a nice day.