OP here with an update. We ended up getting a 2wd van for our group of 6. It has studded tires has been perfectly fine for our needs. We are staying in an Airbnb outside of central Reykjavík and use to shuttle to restaurants, grocery’s stores and the airport. We will be doing tours for the longer more risky drives (i.e. south coast).