Limited options.

Seat belts are actually detachable from the seat pretty easily on many aircraft, so if they had an extra on board (or wherever the extra seat cushion came from), that could be switched out as well.

If not, you're within your rights to demand a different seat, but if the flight is 100% full, that dry seat might be on the next plane out.