I suggest staying in Nairn, a lovely seaside village about 20 minutes from Inverness. We stayed at the Sunny Brae B&B, our favorite place on the whole trip.
From Nairn, we visited the following:
Elgin Cathedral ruins
Biblical gardens behind the cathedral
Whiskey at the Glen Moray Distillery
Cawdor Castle & gardens
Culloden Battlefield
On our way to Skye from Nairn, we visited Urquhart Castle, and then stopped at Eilean Donan Castle for photos.
If you decide to stay in Nairn, let me know. I can recommend some restaurants.
Also want to add that Skye really deserves 3 nights. And I would stay in Glencoe village instead of Fort William. Maybe omit Oban and add that night to Skye?
Are you flying home from Edinburgh? If so, depending on what time your flight is, you might want to stay at a hotel near the airport instead of staying in Stirling. We drove from Glen Coe to our hotel by the airport, and stopped at Stirling Castle along the way. It worked out perfect for us.