AI · Studies · 2026-10-28 13:48
Starting from gradient descent, the article derives the Muon update rule step by step, showing how viewing matrices as transformations makes AdamW no longer seem like the obvious default choice.
Source: lucastononro.github.io
Auto-generated summary for reference only. RSS