# Motif 3 brings a sparse MoE approach to reasoning

> Motif Technologies debuts a mixture-of-experts language model built around grouped differential latent attention for long-context reasoning and code.

Published by The Open Weights on Aug 7, 2026. Canonical: https://theopenweights.com/news/motif-3-a5d4

## Key facts

- Company: Motif Technologies
- Model: Motif 3
- Version: 3
- Category: Text / LLM
- Modalities: Text / LLM, Reasoning, Code
- License: Other (Open weights, commercial use allowed)
- Context window: 262K tokens
- Architecture: MotifForCausalLM
- Precision: BF16
- Weights size: 629.7 GB
- Significance: notable
- Published: 2026-08-07
- Last verified: 2026-08-18
- Hugging Face: https://huggingface.co/Motif-Technologies/Motif-3
- Canonical URL: https://theopenweights.com/news/motif-3-a5d4

Motif Technologies has released [Motif 3](https://huggingface.co/Motif-Technologies/Motif-3), a sparse mixture-of-experts (MoE) language model aimed at reasoning, code, and long-context tasks. The model is available on Hugging Face, with an accompanying paper describing its architecture.

The headline design choice is what Motif calls grouped differential latent attention, an attention mechanism intended to sharpen the model's focus during long-context and multi-step reasoning. Paired with a sparse MoE backbone — where only a subset of expert parameters activate for any given token — the approach is meant to keep inference costs manageable while scaling total capacity.

## Why it matters

MoE architectures have become one of the dominant strategies for building capable open models without paying the full compute price of a dense network at every step. Motif 3 adds another entrant to that field, and its attention variant is the differentiating bet:

- Sparse MoE design to balance capacity against active compute
- Grouped differential latent attention targeting reasoning and long context
- A stated focus on both text reasoning and code

Several key details remain unspecified in the release record, including the total and active parameter counts, context window length, and licensing terms, which are listed as "other." Those specifics will matter for anyone weighing Motif 3 against established open MoE models. For now, the [model card and paper](https://huggingface.co/Motif-Technologies/Motif-3) are the best starting points for teams evaluating the architecture's claims firsthand.

## Get the model

- [Hugging Face](https://huggingface.co/Motif-Technologies/Motif-3)

## Sources

- [Motif-Technologies/Motif-3](https://huggingface.co/Motif-Technologies/Motif-3) — Hugging Face, Aug 7, 2026

---
Source: The Open Weights (https://theopenweights.com/). Aggregated and written by Claude, curated by humans. Cite as: "Motif 3 brings a sparse MoE approach to reasoning", The Open Weights, Aug 7, 2026, https://theopenweights.com/news/motif-3-a5d4