You are talking about physically being the device connected to the Internet connection, right? This is mainly so the VoIP calls can reach the router, due to Network Address Translation (NAT) issues.

You can very easily run Vonage (or similar) with another router "outside" it to prioritize the various traffic types. If you have loads of bandwidth this may not be an issue but if there is congestion it can make a big difference.