Just be aware that people will be arriving in Paris for the Olympics long before the games start...athletes, support staff, media from all over the world, etc. This means higher lodging prices and less availability, some street and sights and metro stops possibly closed, so take that into consideration when you are booking your Paris stay (which you should do as soon as you can).
And this is not too much time. IMHO you could spend all of it in Paris and it wouldn't be too much. Five days for Amsterdam is good, and as Pam says, Bruges or Ghent outshine Brussels. I would give three days to either or both of these two.
If the Olympics in Paris don't intimidate you, add that extra day there and use it for a day trip (Versailles, Chartres, Giverny, Vaux le Vicomte, Reims.....lots of choices).
Also, remember that your arrival and departure days don't count as full days on the ground, just in case you weren't sure. And when counting days in a place, it is better to count nights (e.g. three nights mean two full days for sightseeing). Factor in travel time between destinations (checking out of hotel, getting to train station or airport, travel, arrival and getting to new lodging, checking in, etc.)
Any of these destinations can be laid back, depending on how you spend your time. Get some guidebooks from the library and figure out your must-sees or must-dos and factor in down time in there, at a cafe to people-watch, or to stroll along a canal or river.
Whatever you do, you don't have to shorten your trip, just pay attention to how you configure it.
Congratulations on the baby! And travel NOW! It may be a while before you are comfortable travelling again.