The Open Weights
LatestModelsLeaderboardsCompanies
Subscribe
The Open Weights

The daily record of open-source AI. New model releases, leaderboards, and what's coming next — written for people who ship.

Refreshed every 12 hours

Discover

  • Latest releases
  • New today
  • Trending models

Browse

  • All models
  • Companies
  • Categories
  • Leaderboards

About

  • About
  • Editorial policy
  • Hardware estimates
  • RSS feed
  • llms.txt
  • Newsletter

© 2026 The Open Weights. An independent publication.

PrivacyTermsSMSAggregated by Claude · curated by humans.
LatestMotif Technologies3
Motif TechnologiesText / LLM

Motif 3 brings a sparse MoE approach to reasoning

Motif Technologies debuts a mixture-of-experts language model built around grouped differential latent attention for long-context reasoning and code.

Aug 7, 2026
NotableOther
Motif 3

Motif Technologies has released Motif 3, a sparse mixture-of-experts (MoE) language model aimed at reasoning, code, and long-context tasks. The model is available on Hugging Face, with an accompanying paper describing its architecture.

The headline design choice is what Motif calls grouped differential latent attention, an attention mechanism intended to sharpen the model's focus during long-context and multi-step reasoning. Paired with a sparse MoE backbone — where only a subset of expert parameters activate for any given token — the approach is meant to keep inference costs manageable while scaling total capacity.

Why it matters

MoE architectures have become one of the dominant strategies for building capable open models without paying the full compute price of a dense network at every step. Motif 3 adds another entrant to that field, and its attention variant is the differentiating bet:

  • Sparse MoE design to balance capacity against active compute
  • Grouped differential latent attention targeting reasoning and long context
  • A stated focus on both text reasoning and code

Several key details remain unspecified in the release record, including the total and active parameter counts, context window length, and licensing terms, which are listed as "other." Those specifics will matter for anyone weighing Motif 3 against established open MoE models. For now, the model card and paper are the best starting points for teams evaluating the architecture's claims firsthand.

Sources

  • Motif-Technologies/Motif-3

    Hugging Face

    Visit
OlderMameLoshnLM Brings Yiddish Into the Open LLM EraOpenMOSS · Text / LLM · 4 months agoNewerMiniMax Opens Its Music3 Text-to-Music ModelMiniMax · Music · 3 months ago

Get the model

Hugging Face

Specs

Context window262K tokens
Size629.7 GB
PrecisionBF16
ArchitectureMotifForCausalLM
LicenseOTHER
Downloads340
Likes217

Can you run it?

Needs a multi-GPU server — about 190.5 GB at 4-bit.

  • BF16 (as published)

    8×H100 80 GB node

    631.2 GB
  • 8-bit

    8×H100 80 GB node

    335.4 GB
  • 4-bit

    4×H100 80 GB · 512 GB Mac Studio

    190.5 GB
Your machine
GGUF builds
  • Mixture-of-experts: every expert must be loaded, so memory follows total parameters, not the active slice.
  • KV cache sized for 8,192 tokens of context; longer prompts need proportionally more.

Based on Hugging Face weights metadata. Assumes an 8K context and ~1 GB runtime overhead; actual needs vary. How we estimate


Modalities

Text / LLMReasoningCode
2 versions — view changelog

The Weekly Weights

Every open release that mattered, one email a week.

0 comments

No comments yet. Be the first to weigh in.

More from Motif Technologies

All Motif Technologies releases →
Motif 3
Motif Technologies/Text / LLMMulti-GPU server

Motif Technologies debuts Motif 3 Beta, an MoE model

The Korean AI lab's preview release is a mixture-of-experts language model built for long-context, multilingual work.

Jul 20, 2026
Motif-Video-2B
Motif Technologies/Text → VideoRuns anywhere

Motif Releases 2B Open-Source Text-to-Video Model

The new Apache 2.0 licensed model uses a diffusion transformer architecture to offer a new open alternative for video generation research.

Apr 14, 2026

More in Text / LLM

All Text / LLM →
Aion-1.0-Instruct-2.3B
Microsoft/Text / LLMRuns anywhere

Microsoft's Aion 1.0 Instruct is a compact 2.3B chat model

A small, multilingual instruction-tuned model aimed at chat and summarization lands on Hugging Face.

Nov 18, 2026
SenseNova-Loop-9B
SenseTime/Vision-LanguageRuns on a laptop

SenseTime Releases Looped 9B Multimodal Model

The company's new SenseNova-Loop-9B pairs vision-language capabilities with a recurrent looped-transformer design.

Nov 17, 2026
Hunyuan Hy4-flash
Tencent/Vision-LanguageMulti-GPU server

Tencent releases Hunyuan Hy4-flash multimodal MoE

The lightweight, mixture-of-experts model adds vision and text instruction-following to Tencent's open Hunyuan lineup.

Nov 17, 2026