If the bag hadn't mysteriously slid back (while the aircraft was parked at the gate) and then been removed, OP would presumably have had the bag unsecured behind his lower legs during takeoff. This is a big safety violation and could have easily compromised the ability of others seated in his/her row to evacuate the aircraft quickly in an emergency.