I remember talking to some of the CO management years ago, and they wanted to profile likely bumpers so they can call them out for their known flexibility if they're in a bind.
If anything, a repeat bumper is a good thing for the airline -- it helps them resolve a situation easily with someone who is accommodating. You're also often a GA's friend, since you know the drill, don't need a lot of hand holding, etc. Remember, if they don't get volunteers, they need to pay someone cash to get off the plane.
You have nothing to worry about so long as you're taking the bump in good faith -- you are intending to fly when you approach the interaction, you fly the flight if you're not needed, and you ultimately fly the backup flight if you are bumped.