Kashmir is a trouble spot. There is always a "first time" where there is trouble. People were kidnapped in Kashmir; I could not care less if it was in the mountains or wherever. Going there is still playing with fire.
However it's a question of "gut feeling." And one is "free" to travel where one wants to. To each his own.