This applies to all airlines...just try and book directly with them. Even when you use google flights, you can book with 3rd party sites for 40-100$ less...not worth it in my opinion.
I would really try and push with Amex...not sure you can get Swiss to move on such issues.