01Machine Learning Systems · August 2026 · 16 min read
271,104 Routes: What I Missed About Mixture-of-Experts
I pulled 271,104 token-to-expert assignments from an IBM Granite forward pass, then used them to understand what happens after an MoE router returns top-k.




























