I would persist. I understand Israel has fairly good consumer protections when it comes to flights so would try there. I would also reopen a case with Chase. If you can ask TLV airport what the issues/status was of the flight by email this would strengthen your case. Lastly, did the Chase card have travel insurance?

They do seem to fly from Greece to TLV - likely as a charter?

https://www.planemapper.com/flights/4D2048