# NVIDIA's Nemotron 3.5 Super VL Pairs Vision With MoE

> The new vision-language model carries 120B total parameters but activates just 12B per token, aiming to keep multimodal inference efficient.

Published by The Open Weights on Oct 12, 2026. Canonical: https://theopenweights.com/news/nemotron-3-5-super-vl-120b-a12b-xv0h

## Key facts

- Company: NVIDIA
- Model: Nemotron-3.5-Super-VL-120B-A12B
- Version: 3.5-Super-VL
- Category: Vision-Language
- Modalities: Text / LLM, Vision-Language
- License: Other (Open weights, commercial use allowed)
- Parameters: 120B (mixture of experts)
- Active parameters: 12B
- Context window: 1.0M tokens
- Architecture: NemotronH_Omni_Reasoning_V3
- Precision: BF16
- Weights size: 248.9 GB
- Significance: notable
- Published: 2026-10-12
- Last verified: 2026-10-21
- Hugging Face: https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16
- Canonical URL: https://theopenweights.com/news/nemotron-3-5-super-vl-120b-a12b-xv0h

NVIDIA has published **Nemotron 3.5 Super VL**, a vision-language model built on a mixture-of-experts design, to [Hugging Face](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16). The release weighs in at 120 billion total parameters but activates only about 12 billion per token, a configuration NVIDIA labels "120B-A12B."

The model handles both image and text inputs and is described as multilingual, positioning it for document understanding, visual question answering, and other multimodal tasks where broad language coverage matters. It is distributed in BF16 format under a custom NVIDIA license rather than a standard permissive one, so teams should check the terms before deploying.

## Why it matters

The appeal of a sparse MoE for vision-language work is cost. By routing each token through a small fraction of its experts, Nemotron 3.5 Super VL can offer the capacity of a large model while keeping the compute footprint closer to that of a 12B dense network.

- **120B total / 12B active:** large capacity, lean per-token compute
- **Vision + text:** multimodal inputs for document and image reasoning
- **Multilingual:** aimed at use beyond English

As the first entry in the Nemotron 3.5 Super VL line, the model extends NVIDIA's push to supply open-weight building blocks for enterprise AI. Details on context length and benchmark results will be worth watching as the model card and community evaluations mature.

## Get the model

- [Hugging Face](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16)

## Sources

- [nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16) — Hugging Face, Oct 12, 2026

---
Source: The Open Weights (https://theopenweights.com/). Aggregated and written by Claude, curated by humans. Cite as: "NVIDIA's Nemotron 3.5 Super VL Pairs Vision With MoE", The Open Weights, Oct 12, 2026, https://theopenweights.com/news/nemotron-3-5-super-vl-120b-a12b-xv0h