I would not 'forget' the true and helpful comments regarding Zermattt. I would also keep in mind that everyone who has posted about Zermattt has actually been there.
While the Matterhorn is beautiful and iconic it is not the end-all of all Swiss alpine scenery. If you have a unique place to stay outside of Zermatt, like up in the mountains (we did the Basecamp Matterhorn in 2014), you can enjoy the mountains without all of the hassles of the city. As for scenery, there are many places as pretty, or Swiss, as this area without the crowds.
I do repeat, though, everyone who is commenting has been there. Some folks think it is too this or that (me included) and some people don't, but we all took the time to go there for one reason or another and see it. To me however, if you aren't 'going up' I would skip it. I wouldn't have even gone in 2014 but the Basecamp on the Hirli was only up for 30 days and you had to go THERE to see it:) Difficult/expensive to get to, expensive to stay in, crowded shoulder to shoulder at the end of September (I can't imagine summer tourists!), Disney-esque, expensive to eat in.
Either way have a good trip!