Hmm...sounds like a defective unit - can you not return it, and get another one under the warranty?
I would think that if you would hold it against the skin while talking, it would not give as good an experience, as the sensitivity of the sensor would be degraded slightly due to the pressure being exerted on the whole unit against the skin