Since you are coming into Holyhead, you could easily get to Chester.
There is plenty to see there, including the medieval buildings you spoke of.
Warwick is also a town with many medieval buildings left, quite compact center,
with a medieval castle as a bonus. Warwick is directly on the rail line and easily reached.
If it's great cathedrals you wish to see, consider taking the train to Bath for a couple of nights, then on by train to
Salisbury for a couple of nights.
Salisbury Cathedral is magnificent.
Trains run from Salisbury to London with great frequency, if that is to be your end point.
If cathedrals are your thing, you could take the train from London to York on a day trip to see York Minster there
and the medieval town and walls.
If you are still wanting to go to Bibury, there are a couple of hotels that showed up there when I searched.
The Swan Hotel looked lovely:
https://www.cotswold-inns-hotels.co.uk/the-swan-hotel/
Nigel has given you information about the town with a rail station nearest to Bibury.
You could take a taxi from there to Bibury.
Nearby Cirencester was an ancient Roman town. An interesting town to visit with an excellent museum devoted to Roman artifacts found in the area, the Corinium Museum:https://coriniummuseum.org/
Moreton-In-Marsh is a town easily reached by rail. It is a quiet little town, part of the Cotswolds, easier to reach without a car than Bibury. It is an easy rail journey back to London from here when your time is up. There is an excellent company that does tours of the Cotswolds from Moreton, the Go Cotswolds company. They do a day trip around to a half dozen Cotswold villages.
https://www.gocotswolds.co.uk/
We took this tour last spring and highly recommend them.
There are several B&B's in Moreton that people on this forum have stayed in and liked.
Moreton would be a pleasant village in which to stay, similar (but not identical) to Bibury.