Capsaiscin (sp?) is the chemical part of the food that makes it spicy. It is not water soluble so drinking water does not help get rid of it. It is however soluble in fat or alcohol. Therefore, if you can't find milk, may I recommend a cold beer.

Sugar also helps--Scoville Units (commonly used to measure spiciness) measure how much sugar it takes to neutralize the spicy taste.