Yes. The £35 per person cancellation is deducted from the cash element you paid. If you paid less than £35 to start with then you just lose the cash, you are not asked to cure the difference.
All the avios are refunded, as long as you cancel more than 24 hours before the flight.
Note that at the moment you must call to do voluntary cancellations, the website will only give future travel vouchers.