Buy the big tickets (ICE) to the major cities, Munich, Frankfort and
Nuremburg prior to trip. Buy day trips To outlying towns from base
towns on the day we’re headed to those particular towns. (Regional
towns?)
Yes, that's the BASIC idea, liebet.
"Day passes" is a pretty big category. There is a national day pass, then there are "Länder" (state) day passes, and then there are transit authority day passes. You'll be on the Rhine. So let's say you are staying a few days in Rüdesheim (a popular and touristy place not far from Frankfurt.) Which day pass is best for your train journey depends on your destination.
Going into Frankfurt or Mainz for the day? An RMV (the local transit authority) day pass ("Tageskarte") is in order.
To Cochem (Mosel River) you'd want a Länder Ticket for the state of Rheinland-Pfalz (Rheinland-Pfalz ticket.) Even though "ticket" is part of the name, it's a day pass.
An extra-long day trip - to Stuttgart for example, which takes you outside the R-P travel zone - would require the national day pass for Germany (Quer durchs Land ticket) which is constrained only by the German borders.
All of these day passes put you on the regional trains (RE, RB, VIAS, and other designations) and forbid travel on long-distance trains (IC, ICE, EC, etc.) Most have a single-traveler ticket price and a small-group discount price for 2-5 people (or a price that goes up incrementally with the # of travelers.) Most (but not all) have a restriction on weekday travel before 9 am. Most transit authorities offer a day pass price for system-wide travel anywhere you like within the zone, the whole day long. But they also have cheaper prices for shorter distances.
Example from a Rüdesheim base: a day trip into Frankfurt and back for two adults on a mini-group ticket/day pass is €35 for the RMV ticket because Frankfurt is a "price-level 6" trip based on its distance from R'heim. If you were going to Hanau, a price-level 7 trip, you'd pay €45.50.
These local transit authority day passes can differ quite a bit. If you were to stay in St. Goar (Rhine,) the VRM transit authority for this area offers a system-wide "mini-group day pass" or "Minigruppenkarte" (valid all day Sat or Sun, on weekdays after 9 am) for €24. That's a big discount as the single traveler pays €21. But the single traveler can buy a 3-day pass for €42 (which is valid for three full days, irrespective of the day and hour.) Multi-day passes are somewhat unusual. In the NUREMBERG region (VGN) you can use a system-wide day pass (priced at €23/couple) at any hour of the day, any day of the week. Buy it for Saturday - and remember to keep it - you can use it on Sunday too.
Most smaller stations (like the Rhine towns) are not manned with agents - the day passes can be had at ticket machines - you input your destination, and the machines normally provide the options available at your chosen hour of travel. Read what this traveler to St. Goar (Rhine) says about using the machines.
GUEST TICKETS: These have become a "thing" offered by some local tourist information offices - Book in certain hotels, or in some cases ANY hotel in certain towns, and you can take local day trips for FREE for the duration of your stay with the free guest card you get upon registration. So you might not need to purchase a single day pass at all. BOPPARD (Rhine) is a great town with lots of room and dining options and a very good base town for train travelers. Any room or apartment will get you one of these cards. Details are here.
Several informed forum members here can help you figure out what you need. Come back once you know your day trip destinations.