Thanks for the replies. I phoned again and this time got a really good agent who assured me I would get the avios back and because there had been a slight time change to one of the flights I would not be charged a cancellation fee.