It sounds as if you might enjoy visiting one or two regular markets, not just Christmas markets. I don't know anything about the status of the (often weekly) markets in the winter. Google will probably help you out once you begin to focus on some specific Provencal towns. Winter is not high-season there, so things slow down a lot. You'll even need to check websites of the attractions you hope to visit, because some of them (one hopes not the major ones) may be open only 4 days a week in December.
It looks as if the market in L'Isle-sur-la-Sorgue (I think the largest in Provence) will be operating on Thursdays and Sundays this month, as usual. It wraps up in the early afternoon. The Sunday market is usually larger; I believe the Thursday market is mainly food. The town itself is picturesque and is easier to appreciate when not swamped by market stalls--though market day may well be quieter in the winter.
I liked Avignon a lot and found the Palais des Papes interesting. Many people are disappointed to find that it is essentially unfurnished. So if your primary interest is palatial furnishings, that might be a sight to skip.