Wise men and women of FT.

I no longer need the return flight of a BA booking. Am I able to cancel now (4 weeks before outbound) or should I do it once I've flown the first leg?

I know at best I will only get the taxes back as it's restricted & non-refundable but just wondered if I'd prejudice anything by trying to start the process now.

Thanks