If you are passing through the Dordogne department (which I would recommend - it is on the way)) then the gardens at Marqueyssac are not to be missed. Set on a plateau high above the river Dordogne they have magnificent views of the river and the numerous chateaux in the valley below. The gardens are stunning with swirling sculptured boxwood hedging at one end leading to a labyrinth of long shaded woodland paths that take you to the many other features. It also has a café/restaurant that serves simple food and has one of the best views in France.
Also in the Dordogne are the gardens of Eryignac. These gardens are very formal and very 'French'. More importantly they are unbelievably beautiful. Although they are not huge as you walk round them you will realise they are a work of near genius and incredible skill. Once seen they will remain in your memory forever.
They both have websites to wet your appetite.
As mentioned by others the gardens at Villandry are also amazing (though not on the obvious route from Paris to Portugal).
Anyway I am sure you will have a great time.
Nicholas