Compared with most places in Scotland, Inverness can't really be described s 'relatively small'...It is the major town for that part of the area. It does have plenty of accommodation, restaurants etc. People either love it or hate it... I like it. There is always a buzz and bustle to the place.
While there isn't a lot to actually see Inverness - the castle is currently closed and undergoing a multimillion pound refurbishment as a new visitor attraction planned to open in 2025, with eating and shopping as well immersive experiences about the landscape, heritage, culture and people, surrounded by landscaped gardens. There is a cathedral, museum and some very nice walks along the river.
Scotland doesn't really do 'quaint'. If you wanted a smaller place to stay, then look at Strathpeffer (Victorian spa town), Dingwall or Beauly with its ruined abbey. All are just a short drive from Inverness and would give good access to all of the places listed below.
Inverness is a good base with plenty of choice for day trips.
• Culloden along with Clava Cairns
• Fort George
• Nairn for the sea side
• Elgin with its ruined abbey
• Dornoch with its cathedral
• Dunrobin Castle - home of the Dukes of Sutherland
• Urquhart Castle on Loch Ness with its 'monster'
• Glen Affric - one of the prettiest glens and yet to be discovered - for scenery and walks eg Dog Falls
• Scenic drive to Kyle of Lochalsh (and across the bridge to Skye - but you won't see much of Skye on a day trip...)
• Black Isle - for scenery and small towns
• Aviemore and a trip on the funicular railway to the top of Cairngorm
• Ride on the Strathspey Steam railway
and this is just the start....