There really isn't that much in Port Kent. The boat ride is lovely.

If you are up for it, rent some bikes and head north from Burlington on the rail trail by the lake. I goes up the old railroad causeway. On weekends there's a bike ferry that connects the 2 sections where a bridge was removed.