I like the idea of getting to one of your island destinations upon arrival in Greece, but I really think you're trying to squeeze too many different destinations into the pre-Athens part of your trip. Before you get comfortably relaxed anywhere, you're going to have to head to the airport or ferry port. It is really dangerous to list the same day in two different places as you are doing. It tends to give you a false impression of how much usable time you'll have in each place. In truth, most of any hotel-change day will be lost to travel time, so such days aren't worth very much in either the departure or arrival city. This is how I'd record your plans:
Day 1: Arrive late in Crete (3 nights). (What city?)
Day 4: Ferry to Santorini (2 nights)
Day 6: Ferry to Milos (3 nights)
Day 9: Ferry to Athens (6 nights)
Day 15: Fly back home
The number of real, full days you have at each stop is one less than the number of nights (Crete 2, Santorini 1, Milos 2, Athens 5).
Some specific comments:
Especially with a really late arrival on Day 1, you may still be dragging on what I'm calling Day 2 (which you were counting as Day 3). Crete is huge, it takes quite a long time, in some cases, to move from point to point. The key sightseeing attractions are in the west; the party-hearty spots are in the east. A huge island is not a great choice for such a short visit. And once you're in Crete, you have quite a long ferry trip to the Cyclades. Although Crete is my favorite of the islands I've seen (which is only 7), I wouldn't go there for just 3 nights. That's only 2 days, and one of those may be somewhat jetlagged.
Santorini is expensive and very touristy as well as very scenic. I think quite a lot of people probably only spend two nights there.
I haven't been to Milos, but I imagine it will be a nice contrast to Santorini.
Athens has some incredible classical sites and museums. Except for the (very touristy but ancient) Plaka, it is not a very attractive city, to my mind. It doesn't have the large neighborhoods of gorgeous historical buildings you'll find in most other European capitals. I think five nights is a very long time to stay there for the vast majority of tourists.
I'm not sure what's going to happen, price-wise, when you try to buy a one-way ticket to Crete. This has just occurred to me: Do you live in Europe?