Had similar issues - I do think they should enhance the login process though - with my Bank of America account I have an extra layer that sends a 1 time use code to my cell phone to log in
...but in Amex's favour - there's many other sites that need to improve as well!