I don't believe that there is any secret to this.
Cast aluminum is low-density metal and quite porous. I was told that if offers a lot of surface for moisture and contaminants to do their work and oxydize the surface.
Billet aluminum generally holds its polish much longer because the metal is tighter... That's how billet wheels can last a long time between detailing and polish.
In short, you have to maintain it with quality polish and apply a sealer to help delay the effects of oxidation.
Clear coats usually don't last, especially in a hot engine environment. The clear dries up, shrinks and peels over time.
A friend of mine has a 32 ford with magnesium Halibrant wheels. He got them polished, then powder cooated clear. He though he was out of the woods. But somehow oxidation slowly worked its way underneath the clear, turning his polished mags to a shiny, olive drab color. Now he has to get them stripped off the powder coat and polish them again - every week!