I once had an issue with someone in my seat after an agent-initiated boarding pass screwup. The FA told me to go back and see the GA but I refused to step off the airplane knowing they can de-board you with little recourse and insisted the GA come sort it out on board. If you’re physically on the plane it’s much harder for them to pull this. Plus there are more witnesses.