AMD's Instella-MoE Brings Reasoning to ROCm Hardware
A new open mixture-of-experts model with 16B total parameters and just 3B active is tuned to run on AMD's own accelerator stack.

AMD has released Instella-MoE 16B A3B Think, an open-weight reasoning model built as a mixture of experts. The design pairs 16 billion total parameters with roughly 3 billion active at inference, a structure meant to keep compute costs modest while retaining the capacity of a larger network.
The "Think" label signals the model's focus: it is positioned as a reasoning-oriented system rather than a general chat assistant, joining a growing field of open models that expose step-by-step problem solving. It handles text generation alongside its reasoning workload.
Why it matters
The most notable angle here is the hardware. AMD explicitly optimizes Instella-MoE for its ROCm software stack, giving developers on AMD accelerators a first-party option rather than defaulting to models tuned for competing platforms.
- 16B total parameters, ~3B active per token
- Reasoning and text generation focus
- Optimized for AMD's ROCm ecosystem
- Open weights available on Hugging Face
As an initial 1.0 release, Instella-MoE reflects AMD's continued push to build a credible open-model presence tied to its own silicon. The weights and details are published on Hugging Face under a custom license, so teams weighing it for production should review the terms before deploying.
Sources
- Visit
amd/Instella-MoE-16B-A3B-Think
Hugging Face
More in Reasoning
DeepSeek Ships V4-Flash, a 304B MoE Tuned for Agents
The latest checkpoint in DeepSeek's V4 line leans into agentic workflows while keeping the permissive MIT license.
DeepSeek Refreshes V4-Flash With New 0731 Checkpoint
The MIT-licensed mixture-of-experts model returns in an updated build shipping with FP8 weights for cheaper inference.

LG AI Research debuts K-EXAONE 2.0, a 750B MoE model
The new mixture-of-experts model activates 37B parameters per token and targets English, Korean, and Spanish reasoning tasks.
0 comments
No comments yet. Be the first to weigh in.