Qwen releases 2.4T-parameter open MoE with 95B active
Alibaba's Qwen team pushes its largest sparse model yet, activating 95 billion parameters per token from a 2.4-trillion-parameter pool.
Qwen, the AI group inside Alibaba, has published Qwen3.8-2.4T-A95B on Hugging Face — a text and reasoning model that stands as the team's largest open Mixture-of-Experts release to date. The headline figures are in the name: roughly 2.4 trillion total parameters, with about 95 billion active for any given token.
That sparse design is the whole point. Rather than firing every parameter on every forward pass, an MoE routes each token to a small subset of specialized "experts." The result is a model with the knowledge capacity of a very large network but the per-token compute closer to a mid-sized dense model. In practice, the 95B active count is what determines inference cost, while the 2.4T total sets the ceiling on what the model can store.
Why it matters
- Scale meets openness. Frontier-scale MoE models have largely stayed behind closed APIs; shipping weights at this size continues Qwen's push to keep serious capability in the open ecosystem.
- Reasoning focus. The model is tagged for both general text and reasoning, signaling it's aimed at the harder problem-solving workloads that increasingly define the top tier.
- Deployment realism. A 2.4T-parameter checkpoint is not something most teams will run casually; expect adoption to concentrate among well-resourced labs and inference providers.
One caveat worth flagging: the release carries an "other" license rather than a standard permissive one, so teams should read the terms on the model page before building on it. As always with a fresh drop, independent benchmarks and real-world testing will determine how the raw parameter counts translate into everyday performance.
Sources
More in Text / LLM
Allen Institute Open-Sources AstaBrief Report Model
The fast report-generation model behind AI2's Asta research assistant is now available under an Apache 2.0 license.
Aleph Alpha releases Kolibri, a sovereign reasoning model
The German AI company's open-weight mixture-of-experts model targets European needs with strong German and English reasoning.

Fastino's GLiNER2.5-Decide targets lean NLP tasks
A sub-1B model bundling entity extraction, intent, sentiment and topic classification arrives on Hugging Face.
0 comments
No comments yet. Be the first to weigh in.