I would plan on five hours round trip for your hike up and down Misen. Sure, you can probably do it faster, but if you aren't taking the time to look at the view and wander the side trails to the various temples and shrines, why climb it in the first place?