A delay isn’t usually enough to get a change of destination. Even if it was allowed (and you indicate you are on a restricted ticket), it is also highly unlikely to generate a refund.

I would’ve thought your only hope of dropping the segment is getting your LHR-MAD sector pushed back a day later than your LHR arrival (greater than 24 hours if you have checked luggage) and then simply no show last leg.