Maybe, but I wouldn't let that stop me from going. After I visited Lahore a couple of years ago I had a couple of minor issues with immigration in the next month due to having been in Pakistan. No references since.

I had a harder time entering USA last year on a RTW that included visits (before reaching USA) to such places as Iran, Iraq, Libya. However subsequent visits to USA have had no issues.