What is…
Mixture of Experts (MoE)
A model built from many specialist sub-networks where only a few 'experts' activate for each token.
Instead of one giant network doing all the work, an MoE model has many expert blocks plus a router that picks the best few for each token. The model can have a huge total parameter count while using only a fraction per step — big-model knowledge at closer to small-model cost.
Many frontier and open models (Mixtral, DeepSeek, Qwen and others) use MoE designs.
💡 Think of it like
A hospital with a triage nurse: you don't see every doctor, just the two specialists your case needs.
🧠 Test yourself
Which of these describes Mixture of Experts?
Related terms
🎮 Learn AI by playing
40 bite-size missions, boss battles and a certificate. Free.
Start the bootcamp →☀️ One AI term every morning
Plus the day's top stories, in your inbox by 8am.