Well, no one important, at least. I think there are a number of, perhaps quite bitter people, who are so self-motivated that they truly believe everyone should abide by their preferences, and have become so jaded after so many cruises that they actually spend time aboard ship taking offense at what other people are wearing in their "royal" presence.

This is perhaps the best rule of thumb: If you would wear it for time at the pool, then don't wear it to dinner.