I've spent many days in Prague (and have had a few good friends live there) and can honestly say that I've never been overly worried about crime. Of course, crime exists just like any there major city but being sensible reduces the chance of most of it. Can't say I've ever taken a taxi there though, as I prefer the trams