No, no-one will care. The only issue would come if your US passport gets rejected as well and you have to go to the reject desk, where you may be asked a few questions to establish your reason for entering the U.K, but that’s all.

It usually means your U.K. passport has a fault or it might be user error.