On many cases you can access the handle mechanism from the inside. Just take the lining out. Sometimes there is a zip or velcro allowing you access.

You can usually take out the entire handle assembly. Then you can see where the "sore spot" is and possibly repair it. I suppose it is just something that needs to be re-aligned and maybe given a bit of lube.

Till