Cat, it's technically possible to visit all these places in 2 weeks, but you are right to suppose that you will have a better time if you pare things back.
What kind of alpine visit do you have in mind? If the idea is to get up close and personal with the mountains then I think you want to go on to Chamonix from Annecy, but if you do that then Provence becomes, in my view, a place too far. One reason for this is you want to spend several full days in Chamonix because the weather is iffy and if you've only allotted one day and it rtrains that day you will have come a long way for nothing.
So you have (in my view) a choice between deep alps and Provence. Here are some possible itineraries:
Deep Alps 1: Paris, Lyon, Annecy, Chamonix, fly home from Geneva.
Deep Alps 2: Paris, Annecy, Chamonix, Lyon, fly home from Lyon or Paris (2 hour train ride to the airport from Lyon).
Provence: Paris, Lyon, Annecy, Arles (or other Rhone Valley town). Fly home from Marseilles or deGaulle (3 hour train ride)
You could also leave Lyon for another trip to allow more time in Provence, but Lyon is a wonderful city.
Provence is a very rich and rewarding region. You could spend a lot of time there and not be bored. If you go for more than a few days I strongly recommend renting a car to explore the region.
Remember the first day on the ground often winds up as a sort of orientation and recovery day that is light on actual sightseeing. Do give yourself enough time to enjoy these wonderful destinations.