On the cruises I've been on (granted, they were all 5+ years ago), they held my passport until the end of the cruise. I was hoping I could have got it back and tried to get some visa stamps in it (a little hobby of mine). They were firm on that I could not have it. I should have brought one of my other passports to try and get it stamped.