You say you smoke occasionally. How smoky do your clothes smell? I often find smokers fail to acknowledge (or even realize) the stench of tobacco/nicotine that surrounds them and can very easily infuse a small space over the course of even several hours. While I don't condone the slough off the front desk was giving you, you might wish to reflect on the intensity of the smoker's residue you may well carry with you.