I'm amazed at all these posts, really. Along with the degradation in manners, vocabulary in general has decreased among the general population. While vulgar, curse words are heard much more frequently in the past.
That said, no one but the OP, FA and folks sitting in the area are privvy to what actually transpired, the tone of voice, the decibel level, etc to denote whether this was just a generic comment or could be mistakenly taken as directed at the FA, etc. As such, I'll refrain from frying the OP with the rest of you.
I'd get the police report as someone mentioned above, ensure its accurate and attach it to a letter to the airline requesting an explanation for why a comment to an FA can be taken to such an extreme that would get you escorted off the flight, interrogated and placed in a humiliation position, etc.