Qwen releases 2.4T-parameter open MoE with 95B active
Alibaba's Qwen team pushes its largest sparse model yet, activating 95 billion parameters per token from a 2.4-trillion-parameter pool.
Qwen, the AI group inside Alibaba, has published Qwen3.8-2.4T-A95B on Hugging Face — a text and reasoning model that stands as the team's largest open Mixture-of-Experts release to date. The headline figures are in the name: roughly 2.4 trillion total parameters, with about 95 billion active for any given token.
That sparse design is the whole point. Rather than firing every parameter on every forward pass, an MoE routes each token to a small subset of specialized "experts." The result is a model with the knowledge capacity of a very large network but the per-token compute closer to a mid-sized dense model. In practice, the 95B active count is what determines inference cost, while the 2.4T total sets the ceiling on what the model can store.
Why it matters
- Scale meets openness. Frontier-scale MoE models have largely stayed behind closed APIs; shipping weights at this size continues Qwen's push to keep serious capability in the open ecosystem.
- Reasoning focus. The model is tagged for both general text and reasoning, signaling it's aimed at the harder problem-solving workloads that increasingly define the top tier.
- Deployment realism. A 2.4T-parameter checkpoint is not something most teams will run casually; expect adoption to concentrate among well-resourced labs and inference providers.
One caveat worth flagging: the release carries an "other" license rather than a standard permissive one, so teams should read the terms on the model page before building on it. As always with a fresh drop, independent benchmarks and real-world testing will determine how the raw parameter counts translate into everyday performance.
Sources
More from Qwen · Alibaba
All Qwen · Alibaba releases →Qwen-Audio-3.1-ASR Adds Speaker-Aware Transcription
Alibaba's new open audio-language model transcribes and diarizes speech across 30 languages under an Apache 2.0 license.

Qwen-Image-2.1-Turbo targets faster generation
Alibaba's Qwen team ships a distilled, few-step variant of its image model built for speed.
Qwen-Image-2.1 Adds RGBA to Image Generation
Alibaba's Qwen team updates its open image model with transparency support and joint text-to-image and editing capabilities.
More in Text / LLM
All Text / LLM →
Microsoft's Aion 1.0 Instruct is a compact 2.3B chat model
A small, multilingual instruction-tuned model aimed at chat and summarization lands on Hugging Face.
SenseTime Releases Looped 9B Multimodal Model
The company's new SenseNova-Loop-9B pairs vision-language capabilities with a recurrent looped-transformer design.

Tencent releases Hunyuan Hy4-flash multimodal MoE
The lightweight, mixture-of-experts model adds vision and text instruction-following to Tencent's open Hunyuan lineup.
0 comments
No comments yet. Be the first to weigh in.