Chatterbox
SoTA open-source TTS family by Resemble AI — zero-shot voice cloning, 23 languages, emotion control, MIT-licensed with neural watermarking.
About
Chatterbox is a family of state-of-the-art open-source text-to-speech models by Resemble AI, released under the MIT license. The lineup includes the base English ChatterboxTTS, Chatterbox-Multilingual V3 (0.5B, 23 languages, cross-language voice cloning), a Single Language Pack of dedicated finetunes (Chinese, Latam/Spain Spanish, Brazilian/Portugal Portuguese), Chatterbox-Turbo (distilled 350M for low-latency voice agents), and Chatterbox-Nano (CPU-friendly). Standout features are zero-shot voice cloning from a short reference clip, emotion/intensity control, paralinguistic tags like [chuckle] and [laugh], and built-in PerTh neural watermarking on every output for provenance. Gradio demo apps ship in the repo for TTS, Turbo, voice conversion, and multilingual use.
What it can do
- Zero-shot voice cloning from a short reference clip — no per-speaker training; cross-language cloning in the multilingual line
- Multilingual V3 (0.5B): 23 languages — ar, da, de, el, en, es, fi, fr, he, hi, it, ja, ko, ms, nl, no, pl, pt, ru, sv, sw, tr, zh — plus Single Language Pack finetunes for priority languages/dialects
- Emotion and intensity control plus paralinguistic tags ([chuckle], [laugh], [cough]…) for expressive, conversational speech
- Chatterbox-Turbo: distilled 350M architecture, single-step decoder — vendor claims ~6x real-time on GPU with sub-200ms time-to-first-sound for voice agents (see provider-claimed)
- Chatterbox-Nano: Turbo-class architecture in a CPU-runnable size
- Built-in PerTh (Perceptual Threshold) neural watermarking on every output — imperceptible, survives MP3 compression and editing, with a watermark-extraction script in the repo (documented in README)
- Gradio apps included: TTS, Turbo, voice conversion, and multilingual demos
Setup
Install from PyPI:
```bash
pip install chatterbox-tts
```
Developed and tested on Python 3.11 (Debian 11); dependency versions are pinned in pyproject.toml. Or install from source for hacking:
```bash
git clone https://github.com/resemble-ai/chatterbox.git
cd chatterbox && pip install -e .
```
English zero-shot cloning:
```python
from chatterbox.tts import ChatterboxTTS
import torchaudio as ta
model = ChatterboxTTS.from_pretrained(device="cuda") # or "cpu" / "mps"
wav = model.generate("Hello world", audio_prompt_path="ref_clip.wav")
ta.save("out.wav", wav, model.sr)
```
Low-latency Turbo: from chatterbox.tts_turbo import ChatterboxTurboTTS; ChatterboxTurboTTS.from_pretrained(device="cuda"). Multilingual V3: from chatterbox.mtl_tts import ChatterboxMultilingualTTS; ChatterboxMultilingualTTS.from_pretrained(device=device, t3_model="v3"), then generate(text, language_id="fr"). Model weights download from Hugging Face on first use.
Prerequisites
Python 3.11 recommended (per README; other 3.x may work with source install). PyTorch with CUDA for best results — CPU and Apple MPS also supported, with Nano recommended on CPU. Weights download from Hugging Face on first use (several GB for the 0.5B family). A short reference audio clip (~10s) is required for voice cloning. No API key for self-hosting; Resemble AI also sells a hosted platform separately.
Use cases
Works with
Trust score — 8/10
Scored 8/10 (verified tier, metrics-v1). Evidence: 26,873 GitHub stars (log-scaled vs catalog peers); blended with ~132,991 monthly package downloads; last push 83d ago; 0 releases/12mo; 372 open issues. Manual review: commits slowed since mid-2026; Turbo 'beats ElevenLabs'/sub-200ms claims are vendor PR figures; voice cloning needs owner consent regardless. License: MIT.
★ 26,873 GitHub stars
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 8.1/10
- Maintenance · recency, releases, issue load
- 6.3/10
- Openness · license + docs
- 10.0/10
- Manual review · sanity read + red-flag check
- 9.0/10
- · 26,873 GitHub stars (log-scaled vs catalog peers)
- · blended with ~132,991 monthly package downloads
- · last push 83d ago; 0 releases/12mo; 372 open issues
- · manual review: commits slowed since mid-2026; Turbo 'beats ElevenLabs'/sub-200ms claims are vendor PR figures; voice cloning needs owner consent regardless
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.