You’ll want to stay along the green and yellow tube lines (Circle and District).
Houses of Parliament, Westminster Abbey and Big Ben are the same cluster of buildings (Abbey across the road from Parliament). Note that the clock tower (Victoria Clock? Big Ben is the bell I believe) is under scaffolding for a few more years.
The Houses of Parliament are on the Thames. Across the Westminster Bridge is the London Eye. Long way of saying 4 of your items are within a Tiger Woods drive of each other.
Tower Bridge is 20 minutes on the Circle and District tubes.
Trafalgar Square is 15 minutes from the Abbey if you’re walking.
The Bridge is also on the District line (green tube).
So staying in or around Westminster is about as centrally locates for tour itinerary as possible. May make sense to look at staying in Victoria as well. May be a cheaper option there.
Windsor is outside the city but near Heathrow. Are you flying to London? Flying out of London.