Nigeria visa policy is a moving goalpost subject to random interpretation on the day of departure.
Official policy is that TWOV is permitted, but try convincing a self-righteous Nigerian official about that. A note from Benjamin Franklin often helps.
Don't stress yourself over it. Que sera sera.
PS. If you're in Accra, drop me a PM and I'd be happy to meet up for a beer!