I wouldn't hesitate to do it if there was something that made my radar perk up. I would just be blunt and ask if it is an issue. Or if you want to beat around the bush, ask if they are a member of IGTLA, that would give them an opportunity to tell you they don't want you there.
I personally do not like BNB's or hotels that small, so it would never be an issue for me, lol.