If you store garlic cloves in the cold, like the refrigerator, the germ will develop faster than if you don't.

Some people remove it and say it matters
Some leave it in and say it doesn't
Some believe it's the most flavorful part of the garlic and would never remove it

It affects different people in totally different ways.