I agree, to an extent... I don't think it should simply be he-said/she-said... I think they should take into account what those around witnessed. An airplane is not a large place and with so many pax in close proximity we all KNOW several people could have overheard the exchange. No need to waste the time of anyone on the crew, the ground staff, the police etc over something that simply "pissed you off".
When I have any sort of situation onboard that I write-up, I almost always ask for witnesses and people are almost always willing to offer their perspective. Again, unfortunate experience and one that I'm not proud to know about, unfortunately both pax and FA's are people and "there's always one".... or a few