To the OP - given the plane had returned to the gate, you had the right to get off the plane. If you ever encounter a similar situation in the future, making a 999 call would result in the matter being resolved on the spot and you would be off the plane in no time.

However, given you did not make a specific request to leave the plane, in this situation I think it is clear that you have no recourse whatsoever.