The trouble with this logic is that if a terrorist act ever happens (or when it happens) in some public place, such as a busy intersection, then we are saying that the police should be allowed to search people at random in public places.

This is not the world we want to live in, I wouldn't think. Seaching people in public places with no probable cause is supposed to be unconstitutional.