Yes definitely complain and be clear what you are requesting, ie. refund, points, $$$ compensation etc. I'll let others venture how much.
Outline the compensation offer clearly and then in steps what happened (in brief). Don't shade the truth. Be clear AND truthful--they will likely follow up with the agent at Swissport and it could be a he said she said. If there is paper documentation showing the J booking so much the better.
You should see something for this.