Magical Express after 10pm can take forever. After midnight, I wouldn't dare unless absolutely set on using the service.
Fewer buses are running so depending on how many people are arriving at that time, you could be waiting for longer than you would during peak arrival times.