Field notes · Machine learning systems
Michael Rusu’s ML systems blog
Machine learning systems notes from Michael Rusu covering mixture-of-experts routing, distributed ML, robotics, computer vision, and production AI.
Machine Learning Systems · August 2026 · 16 min read
271,104 Routes: What I Missed About Mixture-of-Experts
I pulled 271,104 token-to-expert assignments from an IBM Granite forward pass, then used them to understand what happens after an MoE router returns top-k.