From Orbetello to Siena first you need to reach Grosseto, the Provincial capital.
You can go to Grosseto from Orbetello via train, from the same station I described in the previous comment. To go to the station you take the same bus.
You can also take a bus from Porto Santo Stefano directly to Grosseto, but there aren't too many buses, so it depends on your schedule. Trains are more frequent, but if you can take the bus below, it's less hassle.
https://www.at-bus.it/en/timetables.html#modTimetables_collapseExtraUrbanLine
Select Suburban Services, the Servizi ExtraUrbani GR, then select bus 39O to download timetable in PDF.
Once in Grosseto you take the bus 51G to Siena
https://www.at-bus.it/en/timetables.html#modTimetables_collapseExtraUrbanLine
Select Suburban Services, Servizi Regionali su Gomma, then select bus 51G to download timetable in PDF
You can buy tickets at authorized retailers (basically Tobacconist shops displaying the Autolinee Toscane logo), ticket machines (where available), or via TabNet app. Details are below (click on tickets then select the Extraurban tickets section)
https://www.at-bus.it/en/