A TSO can't make you do anything. A TSO can only deny you entrance to the sterile area out of concern that you have weapons, explosives or incendiaries. For TSOs who are friendly, polite and efficient, I am friendly and polite in return. For those who think they are General Patton, I either ignore them, call for a supervisor, or call for a LEO.
That said, and regardless of how fast you think you can get through the line with two infants compared to other pax, you're not going to be faster than the average frequent-flying business person with a rollaboard and a computer bag. The polite thing to do would have been to use the family line.
Just my opinion.