It all goes to expectations IMO. Boutique / small luxury properties (e.g. <= 20 rooms) often don't have much space for gyms, spas, etc. which is a tradeoff. Unless there was something that would make me think otherwise, a "petite fitness room" would not really count as a missed expectation in a very small room count property.
Meanwhile if you have a huge grand hotel in a giant building with a "petite fitness room," I feel like it'd be reasonable to expect more (although again relative to other circumstances: e.g. at Gritti Palace in Venice I was forgiving that Doge Gritti didn't consider fitness centers in the 1400s).