Although I'd feel comfortable there, I can see a visitor getting a little squeamish.
The area is very young and very urban. During the day, it's awesome and Tompkins Square Park is great. Honestly, at night, you may not be a big fan, particularly if you look like a tourist.
Further, subway access is not great from there. Not terrible, but kind of inconvenient.