The Rijksmuseum sent me a message with a video detailing the entrance location, lockers, and other important info I was wondering about. If you have tickets, you'll get this video a few business days ahead of your ticketed time. But it might set your mind at ease to see it now:
https://www.rijksmuseum.nl/en/whats-on/exhibitions/vermeer/onboarding-vermeer