Seat reservations on ICE trains

How come certain seats are always greyed out on the seat map and not bookable? Are those first come first serve or are they reserved for something else?

Partly reserved for people with handicap, partly reserved for travelers with high loyalty status.

If you don't have a seat reserved, and some else reserves that seat, you will have to move.

If you want to be certain, you need a reservation. Otherwise you can enter and look at the displays if there is a reservation (provided they work - they sometimes fail). In case you find a seat not reserved, you are safe from there.
If you only find reserved seats, the display should tell you from where on it is reserved - if someone with a reservation shows up, they will ask you to move (and it is their right to do so).

Not all seats are usually in the pool for reservations. Some are for loyalty members, some for disabled passengers, and a few are actually still held as a reserve for people who did not reserve (afaik, might have changed) and work as first come first serve.

Generally speaking, at least in my experience, the indicator is roughly reliable. Note however that it is partly just based on reservations made for this specific train and partly experience/statistics. If you extrapolate from a different day, be aware that a special event like a business fair or soccer game can increase demand significantly.

Thank you

Partly reserved for people with handicap, partly reserved for travelers with high loyalty status.

Are they free for all if it is not occupied when the train leaves?

Are trains usually full on the first station of the route?