I have never removed a visa from my passport, however of the two I have from Kuwait, one has dried up and has come detached from the oriiginal page, while the second is halfway there.
Has any agency questioned the missing visa? No, not yet. I do keep the "missing" visa readily available, but i am concerned about loosing it.