It's usually the adapter. If the adapter is a brick, the adapter is doing the converting. It's putting out 12 volts or whatever the router needs.
I don't think I've ever seen a router for home use that did the converting, it's always been the power adapter doing the work.