Violent crime is quite low...now scams and rip offs....that is another story. Nearly everyone you meet in Tangier and any touristy city will be after your money. They will be your friend and offer to share tea and all sorts of hospitality but it is usually (not always but usually) going to end in them wanting you to buy something and much pressure comes along with this.
Just know if you stand your ground and even become aggressive with them if necessary they will back down. They may yell and gesticulate but they won't become violent normally. If you do choose to buy something know that they will ask for about 10 times or more the proper price so if you want it you need to argue...
In most places if a stranger is too interested in knowing you they normally have nefarious purposes in mind...don't let your hope for humanity drop your guard.