Sometimes have this problem too. Takes either a couple of resets or about 10 seconds of playing music before it lets me turn it off or a couple of flicks of the hold button or a combo of the above.

Apple hardware is crap. It always was. Apple design is good though. I wish some company would do the design and hardware well.