The common belief is that flights later in the day are more likely to be delayed/cancelled. How much time you need at LIM depends on how flexible your onward ticket and itineraries are.

If you are concerned about the LIM-U.S. flight, you might consider booking it on one ticket.