I haven't eaten dairy products for 20+ years. Before I stopped eating dairy, I would get a stuffy nose within minutes of eating any kind of dairy product. I was living in Madison, WI (the heart of dairy country) when my body stopped tolerating dairy products.
It was probably the cheeseheads that did it to me.