You may consider Dijon capital of Burgundy which is perfect if you also like history and architecture. It is so underrated, you will never find too many
tourists especially in winter. It is also the ideal base to discover Burgundy.
The fine Arts museum "Musée des Beaux Arts" which was founded in 1787 and is one of the oldest in France is housed in the Ducal Palace "Palais des Ducs".This museum contains the finest collection of paintings and sculptures outside of Paris.
If you also like small museums, you will love Magnin museum which is a private one located in one of the nicest private mansions of Dijon (17th century). http://www.musee-magnin.fr
One of the best things to do is to follow the Owl's trail. You'll find the brochure at the tourist offices (2.5€) and it will lead you to all the nicest sites of Dijon at your own pace.
http://www.dijon-tourism.com/uk/dijon_parcours_chouette.htm
http://dijoon.free.fr/bestof/accueil.htm
http://www.caravanabroad.com/dijon.html
Since you like gites, you might consider staying at http://www.myhomeindijon.com (terrific location, right between the Fine Arts Museum and Magnin museum!) a lovely apartment which gets rave reviews on other travel boards.
A Christmas market takes place every year on the main square in front of the Ducal Palace.
http://www.dijon-tourism.com/uk/sortir_culture.htm
Beaune is only 45km South of Dijon, ideal for a day trip, do not miss the Hospices near the tourist office.
http://www.hospices-de-beaune.com/gb/musee/
Bon voyage!