Your question is about personal taste; who are we to say your (or your husband's) dress habits are bad? If he likes wearing a blazer, or you like looking at him wearing one, so be it!
PS Italians are the best-dressed Europeans. Even in Sicily he won't stick out.