I don't check the ratings and don't worry about them. If the restaurant is that bad it would be closed.
As for the people who do worry, if the kitchen in your own home were inspected to the same standard as a restaurant how would it be rated? Be honest.