Remember that as you will be on separate bookings you aren’t connecting and you won’t be protected if your HER-ATH is delayed / cancelled at the last minute and a walk up fare back to the US won’t likely be cheap.
I’d take the advice and fly back to ATH the day before in your circumstances.