If you are in or near Husavik, I highly recommend the Geosea thermal baths. Smallish- facility (160 limit per Rick) with infinity pools on a cliff overlooking the ocean. We were there on a weekday afternoon in late August with about 20 other people. Absolutely fantastic! Price wasn't too bad at approx $30/person.