I seem to recall a restaurant pay at counter situation where the owner was afraid I was tapping my Amex by phone, as though he'd get stuck with its fees if it went through.
I ask at restaurants if not sure. If I saw evidence of Amex acceptance such as a sticker or check-holder, but they refused, I'd report them.