I would hope that at any point in time a pilot would be able to say, "I'm too tired to safely operate this flight".

As long as it's not a regular occurrence, I don't see that as being any different from "I have the flu".

"Pilot fatigue" has been cited as a contributing factor in too many incidents.