Without speaking to the terms and conditions of your specific ticket, I believe that you can cancel until departure time.

The big, big risk here is that you won't be able to reach anyone at BA via their call centres, and thus not be offloaded from the flight. I'm a Gold member and all day struggled to get through to BA on the priority line.