I don't know who "they" is/are either but I don't have anyone concerned with my non-work travels - family, employer, employees, etc. I often head out early morning, evening, weekend, etc. out an about, sometimes in remote areas.
It's mostly landscape photography, so there's not much activity in the city. And sunrise is the best opportunity. Sure, as I discussed in the photography forum, I've found myself laying in a dry creekbed, 1/2 mile off a trail, at sunrise, with no one within at least a mile, with a fractured ankle. But that's the chance I take.
I've hopped in a car with a guy I just met - says he's my driver - and taken a 4 hour drive to Agra and Fatehpur Sikri without a local phone, speaking the language, etc. I just trust that things will work out and I can solve problems that arise.
So far so good.