No, I don't feel bad about any of those things, and I virtually always fly economy. I'm too busy feeling bad about the crappy legroom and seat width to get my knickers in a twist about imagined notions of what the business class pax may or may not be thinking.

And what's this about the agent's mood changing? I doubt that they care, unless your fare class is relevant to what you're trying to do, e.g., get a change or a refund.