I travel all over the world and use ATMs daily everywhere while my banks has no branch outside the country. This is not how it works.
Look at the back of your card. I am sure that your institution is a member of several networks. I would expect your card to work everywhere.
It is however a good practice to always have a second card as a backup. Cards can sometimes be demagnetized or the chip stops working for some reason.