I've never worried about an attack and never skipped a flight due to security concerns.

The only time I've been nervous was when sitting next to a gentleman with serious psychological issues. He talked to himself through the entire flight and wrote with a pen all over his hands and arms. He would have raised my awareness while riding on a bus or walking down the street, so being on a plane really made no difference.