I'd also go for the airport express, however I seem to remember it being nearly $27 each way, unless you get a reduced fare (student, senior, etcetera).

The city is easily to navigate without a car. Public transportation is good and everything is relatively compact.

I'd also go for the ski-jump view. About a 30 minute ride on the subway for a stunning view of Oslo.