# NVIDIA Fuses LLM and ASR in Canary-Qwen 2.5B Model

> The 2.5 billion-parameter speech model combines a FastConformer encoder with a Qwen LLM decoder, a hybrid approach to transcription.

Published by The Open Weights on Jun 26, 2025. Canonical: https://theopenweights.com/news/canary-qwen-2-5b-roef

## Key facts

- Company: NVIDIA
- Model: Canary-Qwen 2.5B
- Version: 2.5B
- Category: Speech → Text
- Modalities: Speech → Text
- License: Other (Open weights, commercial use allowed)
- Parameters: 2.5B
- Precision: BF16
- Weights size: 5.1 GB
- Languages: English
- Significance: notable
- Published: 2025-06-26
- Last verified: 2026-06-17
- Hugging Face: https://huggingface.co/nvidia/canary-qwen-2.5b
- Canonical URL: https://theopenweights.com/news/canary-qwen-2-5b-roef

NVIDIA has released Canary-Qwen 2.5B, a new model for automatic speech recognition (ASR) that takes a novel architectural approach. Instead of a single, end-to-end network, the 2.5 billion-parameter model pairs a specialized audio encoder with a general-purpose large language model for decoding text.

This hybrid design is the model's key feature. It uses a FastConformer encoder, a component optimized for efficiently processing audio signals, to understand the input speech. The resulting representation is then handed off to a decoder based on a Qwen large language model. This allows the system to leverage the powerful text generation and contextual understanding of an LLM to produce more accurate and natural-sounding transcriptions.

The model is designed to be multilingual and handle tasks like punctuation and capitalization automatically, which are common challenges for ASR systems. This approach of using an LLM as a "brain" for a specialized task reflects a broader trend in AI, where generalist models are adapted to enhance specific applications.

Canary-Qwen 2.5B is [available on Hugging Face](https://huggingface.co/nvidia/canary-qwen-2.5b) under a custom community license. Its release provides developers with a powerful new tool for speech-to-text applications and a clear example of how different model architectures can be effectively combined.

## Get the model

- [Hugging Face](https://huggingface.co/nvidia/canary-qwen-2.5b)

## Sources

- [nvidia/canary-qwen-2.5b](https://huggingface.co/nvidia/canary-qwen-2.5b) — Hugging Face, Jun 26, 2025

---
Source: The Open Weights (https://theopenweights.com/). Aggregated and written by Claude, curated by humans. Cite as: "NVIDIA Fuses LLM and ASR in Canary-Qwen 2.5B Model", The Open Weights, Jun 26, 2025, https://theopenweights.com/news/canary-qwen-2-5b-roef