Whisper
Open-source speech recognition that transcribes and translates audio in ~100 languages.
About
Whisper is OpenAI's general-purpose automatic speech recognition (ASR) system, released open-source in September 2022 with full model weights and code under the MIT license. It is a Transformer sequence-to-sequence model trained on 680,000 hours of multilingual, multitask supervised audio, and a single model handles speech recognition, speech translation to English, spoken language identification, and voice activity detection. It ships in six sizes (tiny, base, small, medium, large, turbo — with English-only .en variants for the smaller ones) trading speed against accuracy, and became the foundation of the open transcription ecosystem (whisper.cpp, faster-whisper, and most local transcription tools descend from it).
What it can do
- **Multitask speech processing in one model** (README-verified): multilingual speech recognition, speech translation to English, spoken language identification, and voice activity detection — a single model replacing multiple pipeline stages.
- **Six model sizes** (README table): tiny (39M params, ~1 GB, ~10x speed) → base → small → medium → large (1.55B, ~10 GB) → **turbo** (809M, ~6 GB, ~8x speed; an optimized large-v3 with 4 decoder layers instead of 32, minimal accuracy loss). Multilingual models cover ~99+ languages; `.en` variants exist for English-only use.
- Word-level timestamps, language detection, and translation all via the same CLI/Python API. Note the documented limits: 30-second sliding transcription windows (long files are chunked), and `turbo` was not trained for translation.
Setup
Install the package (Python 3.8–3.11 supported per README):
```bash
pip install -U openai-whisper
```
Install the ffmpeg command-line tool (required for audio I/O):
```bash
# Ubuntu/Debian
sudo apt update && sudo apt install ffmpeg
# macOS
brew install ffmpeg
# Windows (Chocolatey)
choco install ffmpeg
```
Transcribe from the command line:
```bash
whisper audio.mp3 --model turbo
```
Or from Python (models auto-download on first use):
```python
import whisper
model = whisper.load_model("turbo")
result = model.transcribe("audio.mp3")
print(result["text"])
```
Tip: if pip install fails on tiktoken, you may need a Rust toolchain (setuptools-rust) on your platform — documented in the README.
Prerequisites
Python 3.8–3.11, PyTorch (installed as a dependency), ffmpeg on PATH. ~1–10 GB of (V)RAM depending on model size (turbo ~6 GB, large ~10 GB per OpenAI's table). No API key needed for local use.
Use cases
Works with
Trust score — 9/10
110,385 stars, MIT code + open weights confirmed in the repo's LICENSE file (Copyright 2022 OpenAI), peer-reviewed paper (arXiv:2212.04356), and the quickstart (pip install, ffmpeg, one-line CLI) sanity-checked against the README. The README itself discloses the real limitations (30-second windows, turbo translation caveat), which is a good sign. Docked one point because maintenance is slow (last push 2026-08-31) and newer open STT models now compete on benchmarks — the 'best' claim dates to 2022.
★ 110,385 GitHub stars
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 9.4/10
- Maintenance · recency, releases, issue load
- 6.8/10
- Openness · license + docs
- 10.0/10
- Manual review · sanity read + red-flag check
- 9.0/10
- · 110,386 GitHub stars (log-scaled vs catalog peers)
- · blended with ~4,986,176 monthly package downloads
- · last push 42d ago; 0 releases/12mo; 169 open issues
- · manual review: slow maintenance (last push Aug 2026); newer open STT models compete; README discloses real limits
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.