Absolutely worth it. Simple and enjoyable train ride then easy walk to the palace grounds. In February there won’t be massive crowds which will add to your enjoyment. Garden won’t be in bloom but it still worth walking about. I’m NOT a huge history buff but found the 4 hours I spent there extremely interesting. If so inclined and if the timing works u could make a day of Hampton Court and Strawberry Hill House. Think they are about 30 minutes apart.
Another vote for the Sir John C Ritblat gallery at the British Library. Combine it with a meal at the Dishroom near St Martins college. Walk along the canal by St Pancras docks. This whole area has and is going under a brilliant refurbishment. It’s behind St Pancras Station. Look for the Gas Towers.
Museum of London is stellar. I always tell visitors to go and see it. From there 15-20 minute stroll to the glass covered Leadenhall Market. The Bank of England museum is enroute.
Leighton Museum and the Design Museum are near each other. Both visually intriguing. Lupitas Mexican restaurant before or after is a nice respite. About a 15 minute walk. Then stroll through Kensington Gardens past the palace.
The V & A is well done and definitely worth your time.
However there are a number of interesting smaller museums to discover in London as well. Research.
If you seek interesting non touristy spots see what’s happening at Wilton’s Music Hall. Another true hidden gem is Two Temple Palace. You need to check when it re opens in 2018.
Loads of intriguing markets to visit over a long weekend. Portobello, Bourough, Broadway, Maltby or just wander about Brick Lane and Spitafields.
Are you interested in a street art tour? If so: https://www.shoreditchstreetarttours.co.uk
Or check out www.walks.com. Might be a weekend sojourn that meets your fancy.
I’m a cemetary wanderer. The Highgate cemetary tour where Karl Marx is buried is interesting. Meandered around Brompton cemetary on my last trip. Easy to get to via the Tube.