I did this is June and took the 8:45.
According to Rome 2 Rio these are the times: 6:40 AM, 8:45 AM, 11:40 AM which matches up with what I remember.
The line is A15: https://www.edgard-transport.fr/horaires/?rub_code=23
The bus station is underground below the Ibis hotel just the right of the train station as you walk out. There is no left luggage/consignee at the train station but there is a place in town about 5 minutes walk from the train station.
https://pro.provenceguide.co.uk/533/new-la-consigne-luggage-lockers-in-avignon/
The town is right across from the train station - cross the street and enter the ancient city gate and you're there. The left luggage place is a few minutes down the road. Or you can try your hotel but keep in mind you will need to cross from the train station into town, back to the train station effectively to get to the bus so allow enough time.
The bus driver is used to everyone getting off at Pont du Gard so don't worry that he won't announce it or anything. The return bus stop is across the roundabout by the wall just a little down the road. Check the return times and plan accordingly.
1:20 PM, 3:15 PM, 5:30 PM, 6:45 PM
I did the 8:45 to 1:20 and it was certainly enough time.
Enjoy,
=Tod