Talking about speeding & stuff and being a highway delinquent

Can someone enlighten me as to how the point system works here? I had two parking tickets and an illegal u-turn (in front of a police station...duh!). Then I got stopped for talking on my cell (at a red light - by a cop on a bicycle!). He told me 1 point for the crime, but parking fines can get 1 or 2 points... I figured by this time I must be in deep.... But then I got a note telling me that before being stopped for the cellphone incident I had 0 points, but now had 4!!! I asked round at the office and always meet a) with glazed looks as if nobody knows what I am talking about or b) the evil eye - as if to say I should behave as a guest in Japan (which I probably should...but I digress and anyway, I don't behave at home either, so.....).

Any tips would be welcome. At all costs I want to avoid spending a day at Futamatagawa watching another gruesome video in Japanese....