AMD's Instella-MoE Brings Reasoning to ROCm Hardware
A new open mixture-of-experts model with 16B total parameters and just 3B active is tuned to run on AMD's own accelerator stack.

AMD has released Instella-MoE 16B A3B Think, an open-weight reasoning model built as a mixture of experts. The design pairs 16 billion total parameters with roughly 3 billion active at inference, a structure meant to keep compute costs modest while retaining the capacity of a larger network.
The "Think" label signals the model's focus: it is positioned as a reasoning-oriented system rather than a general chat assistant, joining a growing field of open models that expose step-by-step problem solving. It handles text generation alongside its reasoning workload.
Why it matters
The most notable angle here is the hardware. AMD explicitly optimizes Instella-MoE for its ROCm software stack, giving developers on AMD accelerators a first-party option rather than defaulting to models tuned for competing platforms.
- 16B total parameters, ~3B active per token
- Reasoning and text generation focus
- Optimized for AMD's ROCm ecosystem
- Open weights available on Hugging Face
As an initial 1.0 release, Instella-MoE reflects AMD's continued push to build a credible open-model presence tied to its own silicon. The weights and details are published on Hugging Face under a custom license, so teams weighing it for production should review the terms before deploying.
Sources
- Visit
amd/Instella-MoE-16B-A3B-Think
Hugging Face
More in Reasoning
All Reasoning →DeepSeek V4.1-Flash Adds Vision and Reasoning
The new MIT-licensed checkpoint folds image understanding and reasoning into DeepSeek's fast, mixture-of-experts Flash line.
Meta's Muse Spark Open Targets Agentic Coding
The new open-weight model pairs a million-token context window with Meta's bet on long-horizon coding agents.

Sage-A1.5 Brings Agentic Vision to Open MoE Models
InclusionAI's new mixture-of-experts model pairs visual understanding with tool use and code, aiming at agentic workflows under an Apache 2.0 license.
0 comments
No comments yet. Be the first to weigh in.