We rented a car in MEL and the contract prohibited taking the car on ferries. Definitely check with them if a ferry is in the plans. Frankly, the route from Portsea around the bay to Phillip Island passes very close to MEL anyway.
The drive from PI back to MEL wasn't difficult, the roads are in good condition and well-marked. Since everyone leaves around the same time there are other cars to follow.