Presumably once they have boarded everyone and are missing passengers at 20 mins they have to notify the Captain and it's still up to him or her whether to accept? I assume the Captain has to instruct the baggage offloading, and it's not something automatic?
Frustrating for the OP, but agree with the other posters- sounds like an insurance job.