No major downside to using off-airport locations, but keep in mind that off-airport locations often have more limited hours than the airport, so if your flight lands at night or is delayed past 5pm or so, then you may not make it during business hours.

You can check AutoSlash for both airport and off-airport rates since we often have prepaid deals that can be significantly lower than other sites.