I think a lot of the prejudice goes both ways. I can recall a time in Singapore when I observed two clerks joking about how pretended not to understand what a japanese customer had wanted. The customer left in a huff because he couldn't ask them questions about something he wanted to buy.
Of course as an american traveling in Japan you ususally feel pretty welcome.