Phonon-2 brings on-device ASR to Apple Silicon

FermionResearch has published Phonon-2, a compact automatic speech recognition model designed to run locally on Apple Silicon. The model is built on NVIDIA's Parakeet ASR architecture and shipped in a low-bit quantized form, with roughly 600 million parameters and a focus on English transcription.

The pitch here is practical rather than flashy: instead of streaming audio to a cloud endpoint, Phonon-2 aims to do the work on the device itself. For developers building Mac-native apps — note-takers, captioning tools, voice interfaces — that means lower latency, no per-request API cost, and audio that never leaves the machine.

Why it matters

Parakeet has earned a reputation as one of the stronger open ASR families, but running it well on consumer hardware has usually meant trimming it down. Phonon-2's low-bit quantization is the lever that makes a sub-gigabyte footprint feasible on Apple's unified-memory chips.

• Architecture derived from NVIDIA's Parakeet ASR line
• About 0.6B parameters, quantized to low precision
• English-only, optimized for on-device Apple Silicon inference

The release is distributed under a non-standard license, so teams planning commercial use should read the terms on the model card before shipping. For anyone who wants fast, private transcription without a server bill, it's a notable addition to the on-device toolkit.