On a recent trip, my wife and I found the Kroller-Muller Museum to be a delight, especially for Van Gogh fan(atics). It's in the Netherlands about 1.5 hours east of Amsterdam near Arnhem and can be reached by public transportation (note that my spelling of the museum name does not include the accent marks above the o and u).
The Kroller-Muller has the 2nd largest collection of Van Gogh's in the world, 87 paintings they say, plus additional materials such as drawings and a number of paintings by some of Van Gogh's contemporaries and/or early modern successors.
The museum is located roughly 1.25 to 1.5 hours east of Amsterdam, and can be reached from Amsterdam by train to one of two nearby towns, and then one or two buses from the train station to the national park in which the Museum is located. I recommend reading Rick's detailed instructions on getting there by train and bus, his instructions are in his "Amsterdam & The Netherlands" guidebook.
In addition to its extensive collections of Van Gogh paintings and drawings, the museum has an extensive, delightful sculpture garden and also a tasty lunch venue. It's actually located at the edge of one of The Netherland's larger national parks. The location is maybe 15 miles west-northwest of Arnhem, the site of the "Market Garden" airborne operation's failed attempt to end the war by Christmas (1944).
If you do both this museum and Amsterdam's Van Gogh Museum, then in one trip you will have seen a significant percentage of the Van Gogh paintings in the world that are in publicly-available collections!