Aborted landings aren't that uncommon. I'm not nearly as frequent a flier as many here, and I've been involved with about 4 of them. I don't worry about it: I know there are procedures and training in place to handle safe go-arounds.
The pilot usually comes over the PA and says something about the guy in front taking his sweet time getting off the runway. Once or twice I've wondered whether that was true or if our pilot simply goofed up the approach. Oh well...
Aborted takeoffs, on the other hand, are a little freaky...