# NVIDIA's Nemotron-3 Puzzle Brings a Lean MoE to Reasoning

> The 75B-parameter model activates just 9B per token and ships in NVIDIA's NVFP4 format for efficient inference.

Published by The Open Weights on Jun 24, 2026. Canonical: https://theopenweights.com/news/nemotron-3-puzzle-75b-a9b-ko5i

## Key facts

- Company: NVIDIA
- Model: Nemotron-3 Puzzle 75B-A9B
- Version: 3-Puzzle
- Category: Text / LLM
- Modalities: Text / LLM, Reasoning
- License: Other (Open weights, commercial use allowed)
- Parameters: 75B (mixture of experts)
- Active parameters: 9B
- Architecture: NemotronHPuzzleForCausalLM
- Precision: INT8
- Weights size: 53.5 GB
- Significance: notable
- Published: 2026-06-24
- Last verified: 2026-07-16
- Hugging Face: https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4
- Canonical URL: https://theopenweights.com/news/nemotron-3-puzzle-75b-a9b-ko5i

NVIDIA has released **Nemotron-3 Puzzle 75B-A9B**, a mixture-of-experts language model aimed at text generation and reasoning. Despite carrying 75 billion total parameters, the model activates only about 9 billion per token, a design meant to deliver the capacity of a large model at a fraction of the per-inference cost. The weights are available now on [Hugging Face](https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4).

The release ships in NVIDIA's **NVFP4** format, a 4-bit floating-point quantization scheme tuned for the company's own accelerators. That, combined with multi-token prediction (MTP), signals a focus on throughput: MTP lets the model draft several tokens per forward pass, which can meaningfully speed up decoding when paired with the right serving stack.

## Why it matters

Sparse activation has become the dominant playbook for scaling open models without scaling inference bills, and Nemotron-3 Puzzle leans into that trend hard. Its 9B active footprint puts it in reach of more modest hardware budgets than its 75B headline size would suggest.

- **Latent-MoE architecture** with 75B total and 9B active parameters
- **Multi-token prediction** for faster decoding
- **NVFP4 quantization** optimized for NVIDIA hardware
- Positioned for **text and reasoning** workloads

A few details remain unstated in the initial listing, including context length and the specifics of NVIDIA's licensing terms, both marked as "other" pending further documentation. As with prior Nemotron drops, the practical draw will be how the efficiency claims hold up under real serving conditions, and whether the reasoning performance justifies the architecture's added complexity.

## Get the model

- [Hugging Face](https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4)

## Sources

- [nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4](https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4) — Hugging Face, Jun 24, 2026

---
Source: The Open Weights (https://theopenweights.com/). Aggregated and written by Claude, curated by humans. Cite as: "NVIDIA's Nemotron-3 Puzzle Brings a Lean MoE to Reasoning", The Open Weights, Jun 24, 2026, https://theopenweights.com/news/nemotron-3-puzzle-75b-a9b-ko5i