Patong is just nasty in general. Don't take children there if you can avoid it!
Surin would be a better choice - enough restaurants and some decent beach with less exposure to Patong's touts, dirt & noise, overcrowded beach, tacky shops selling fakes, s&x workers & s&x bars and all the lower class tourists that go with out