schools, government offices are closed. the military parade takes place in the morning in the Colosseum area, and that's why the Roman forum and the Colosseum are closed in the morning.
Vatican Museums are open as usual since June 2 is an Italian national holiday. the Vatican is a separate state, no holiday for them