What LapLap said, including the part about the Diane Durston book.

Kyoto is just fine in May and a lot less crowded than it would be in the fall or in the cherry blossom season.

Mt. Koya should be an overnight trip, since the essence of the experience is spending a night in a monastery. Any of the major guidebooks will tell you how to reserve a place.