I'll let someone more familiar with Baltimore chime in, but the location looks marginal - the football stadium will be empty, and most foot traffic will be much farther north, closer to the Inner Harbor attractions. Don't know enough to know if it's simply "less than optimal" or "stay away"
Let me know when your plans firm up next spring - I plan to be at the track.