OmniVoice TTS Offers Zero-Shot Multilingual Voice Cloning

The team behind the k2-fsa speech recognition toolkit has released OmniVoice, a new open-source model for text-to-speech synthesis. Released under an Apache 2.0 license, the model is designed for high-quality, multilingual voice generation from minimal user input.

The system's core feature is its zero-shot voice cloning capability. Using just a three-second audio clip of a target speaker, OmniVoice can replicate their voice and use it to generate new speech. This process works across multiple languages, allowing a user to provide an English voice sample and generate speech in Chinese, Spanish, or other supported languages without requiring specific training.

Beyond simple cloning, OmniVoice also provides tools for "voice design." By supplying a secondary audio recording as a style reference, users can transfer prosody, rhythm, and emotion to the synthesized output. This enables more granular control over the performance of the generated voice.

OmniVoice lowers the barrier for creating custom, expressive synthetic voices for applications ranging from accessibility tools to content creation. Its ability to separate voice characteristics from language and style provides a flexible foundation for developers and researchers. The model and usage examples are available on Hugging Face.