Taxi mafia is big in Lima, and Callao is under strict control.

I did use Uber, from and to the airport.

On the way back from Miraflores they charge a fixed fare of 60 soles, whereas stopping just few meters before or basically anywhere in Lima would hardly cost 18 soles.

Callao area is not a place you want walk with or without your luggage and they know it.