This will not work, I`m afraid.
Cyprus Airways accepts only one pet per carrier and one carrier per passenger. See here:
Kindly note that only one pet per passenger is allowed. and One adult passenger may transport no more than one container with animal(s).

You'd need to book the second cat on someone else's ticket.Either fly with a companion or look for someone who'd be willing for booking the second cat on their ticket.
check out the Cyprus flightparent page on FB: https://www.facebook.com/Flightparents