The Open Weights
LatestModelsLeaderboardsCompanies
Subscribe
The Open Weights

The daily record of open-source AI. New model releases, leaderboards, and what's coming next — written for people who ship.

Refreshed every 12 hours

Discover

  • Latest releases
  • New today
  • Trending models

Browse

  • All models
  • Companies
  • Categories
  • Leaderboards

About

  • About
  • Editorial policy
  • Hardware estimates
  • RSS feed
  • llms.txt
  • Newsletter

© 2026 The Open Weights. An independent publication.

PrivacyTermsSMSAggregated by Claude · curated by humans.
LatestNVIDIA3.5 Lightning
NVIDIAText / LLM

NVIDIA's Nemotron 3.5 Lightning Blends Mamba and MoE

A 30B mixture-of-experts model with just 3B active parameters aims at fast, agentic coding workloads.

Aug 1, 2026
NotableOther
Nemotron-3.5-Lightning-30B-A3B

NVIDIA has published Nemotron 3.5 Lightning 30B-A3B on Hugging Face, a text-generation and reasoning model that leans on an unusual architecture to keep inference costs down. It is a mixture-of-experts design with 30 billion total parameters but only about 3 billion active per token, released here in BF16 precision.

The standout detail is the hybrid layout: the model combines Mamba-style state-space components with a mixture-of-experts structure. That pairing is meant to deliver the throughput advantages of both approaches — Mamba's linear-scaling sequence handling and MoE's ability to route work to a small slice of the network at a time.

Built for agentic coding

NVIDIA positions the release specifically for agentic coding, the kind of multi-step, tool-using workflows where a model plans, edits, and iterates rather than answering a single prompt. A few things stand out for that use case:

  • Only 3B parameters activate per token, which lowers the compute and memory bill for long, repeated inference loops.
  • The reasoning modality suggests it is tuned to produce structured, multi-step outputs.
  • The compact active footprint makes it a candidate for teams that want capable coding assistance without frontier-scale serving costs.

Why it matters: agentic tools call models constantly, so per-token efficiency compounds fast. A sparse, hybrid model that keeps quality up while cutting active compute is exactly the trade-off developers building autonomous coding agents have been looking for.

The model ships under a custom NVIDIA license rather than a standard open license, so teams should review the terms before deploying it. Context length and benchmark figures were not specified in the release record.

Sources

  • nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

    Hugging Face

    Visit
OlderMeituan Ships a Lighter, Sparser LongCat-FlashMeituan · Text / LLM · 4 months agoNewerLiquid AI ships LFM2.5, a 2.6B on-device modelLiquidAI · Embeddings · 4 months ago

Get the model

Hugging Face

Specs

Parameters30B · MoE
Active params3B active
Context window262K tokens
Size65.8 GB
PrecisionBF16
ArchitectureNemotronHForCausalLM
LicenseOTHER
Downloads907K
Likes280

Can you run it?

Runs on a 24 GB GPU at 4-bit.

  • BF16 (as published)

    80 GB GPU (A100 / H100) · 128 GB Mac Studio

    67.2 GB
  • 8-bit

    48 GB GPU (RTX 6000) or 2×24 GB · 64 GB Mac

    34.9 GB
  • 4-bit

    24 GB GPU (RTX 3090 / 4090) · 32 GB Mac

    20.4 GB
Your machine
GGUF builds
  • Mixture-of-experts: all 31.6B parameters must be resident even though only 3B are active per token — active count affects speed, not memory.
  • KV cache sized for 8,192 tokens of context; longer prompts need proportionally more.

Based on Hugging Face weights metadata. Assumes an 8K context and ~1 GB runtime overhead; actual needs vary. How we estimate


Modalities

Text / LLMReasoning
2 versions — view changelog

The Weekly Weights

Every open release that mattered, one email a week.

0 comments

No comments yet. Be the first to weigh in.

More from NVIDIA

All NVIDIA releases →
NVIDIA/Text → Video

NVIDIA's Cosmos 3 Brings Open Interactive World Models

The new open release pushes beyond passive video generation toward simulated worlds that respond to input.

Nov 5, 2026
NVIDIA/Image → Video

NVIDIA Releases Cosmos 3 for World Simulation

The new open models push NVIDIA's world-foundation effort toward interactive, real-time video generation.

Nov 5, 2026
Nemotron Labs Dory 1.0 4B
NVIDIA/Text / LLMRuns on a laptop

NVIDIA releases compact Dory 1.0 4B text model

The new Nemotron Labs model packs a 4-billion-parameter language model trained on NVIDIA's Nemotron datasets.

Oct 16, 2026

More in Text / LLM

All Text / LLM →
Aion-1.0-Instruct-2.3B
Microsoft/Text / LLMRuns anywhere

Microsoft's Aion 1.0 Instruct is a compact 2.3B chat model

A small, multilingual instruction-tuned model aimed at chat and summarization lands on Hugging Face.

Nov 18, 2026
SenseNova-Loop-9B
SenseTime/Vision-LanguageRuns on a laptop

SenseTime Releases Looped 9B Multimodal Model

The company's new SenseNova-Loop-9B pairs vision-language capabilities with a recurrent looped-transformer design.

Nov 17, 2026
Hunyuan Hy4-flash
Tencent/Vision-LanguageMulti-GPU server

Tencent releases Hunyuan Hy4-flash multimodal MoE

The lightweight, mixture-of-experts model adds vision and text instruction-following to Tencent's open Hunyuan lineup.

Nov 17, 2026