I had an agent show me once what scanned with my passport. He was curious as to all the trips I made into the U.S. and wanted to know the nature of them.
He also knew of my previous visa's (TN, B-1 etc.) that were associated to my passport. I didn't see anything about criminal flags but maybe that is because I don't have any problems in that respect.