Personally would rather be woken and asked. Have had the opposite experience with an early AM flight on not much sleep, but definitely wanted to eat breakfast. Woke up as FA was clearing my seat-mates tray. Got whatever was leftover, but would've rather had a choice and eaten sooner.
If I'm asleep that early into the flight, there's a good chance I'll fall right back asleep if I'm not interested in the meal anyhow.