OP - Safety-wise you will be fine. I have walked that area with my two young cousins without problems as well as on my own.
With luggage will be less than convenient. Someone suggested hailing a cab - that is a good idea just because the luggage will be a hassle. If you do not like the idea of standing on the street waiting for a vacant one you can download Uber or Hail-o and have the cab come to you.