Skip to content
← Models
ClosedGoogle/10 trustVerified

UIS-RNN

Google's fully-supervised diarization idea from 2018: an unbounded interleaved-state RNN that learns speaker segmentation from labeled examples instead of clustering blind — historically important, now archival.

Visit official page →

About

UIS-RNN (google/uis-rnn) is the library behind 'Fully Supervised Speaker Diarization' (arXiv 1810.04719), the 2018 paper that argued diarization's clustering step shouldn't be unsupervised when labeled data exists. The model is an unbounded interleaved-state RNN: each speaker gets their own RNN instance sharing parameters, new instances are born via a Bayesian non-parametric process (so the speaker count is learned, not guessed), and the interleaved states carry speaker information through time. Google featured it on the AI Blog in November 2018 ('Accurate Online Speaker Diarization'), and it influenced a wave of supervised diarization work. The open-source reality needs stating plainly: this is NOT an official Google product (says so in the README), the released code is a simplified reimplementation of the internal system, and — critically — Google cannot share the d-vector speaker-embedding system the paper's results depend on, so you get the algorithm but must supply your own embeddings and training data (the repo ships only toy data for the demo). Dependencies are pinned to the PyTorch 0.4/1.3 era, and the repo has been effectively archival for years. Include it for what it is: a landmark idea with runnable reference code, not a production component.

Specs

Context window

Not applicable — online/streaming formulation; RNN state carries speaker history through time

Pricing

Free / open source — Apache 2.0

Free quota

Fully open code — pip install uisrnn; train your own model on your own labeled data (no pretrained weights released)

API access

No hosted API and no released model — pip install uisrnn, bring your own embeddings and training data

Weights

Closed — API only

Released

Not disclosed

Benchmarks

  • Paper reports strong results on internal Google data with d-vector embeddings (author-reported, 2018)\n- The open release ships toy demo data only — no reproducible benchmark possible from the repo as published

Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.

Use cases

speaker-diarizationresearcheducationstreaming-diarization

Trust score — 6/10

/10 trustVerified

Scored 6/10 (TIER verified, metrics-v1). Evidence: peer-reviewed paper (arXiv 1810.04719) plus Google AI Blog coverage; Apache 2.0 code. Strengths: genuinely influential idea (supervised clustering, Bayesian non-parametric speaker count), runnable reference implementation. Docked for: (1) no trained model or usable embeddings released — the results in the paper cannot be reproduced from the repo; (2) archival maintenance state with ancient PyTorch-era dependencies; (3) explicitly not an official Google product. License: Apache 2.0 (code only).

How the trust score is built

Full methodology →
Adoption · stars/downloads, log-scaled vs peers
6.0/10
Maintenance · recency, releases, issue load
2.0/10
Openness · license + docs
7.0/10
Manual review · sanity read + red-flag check
8.0/10
  • · Landmark 2018 paper + Google AI Blog; introduced supervised clustering to diarization.
  • · Open release is a simplified reimplementation; Google's d-vector system cannot be shared — no reproducible benchmark from the repo.
  • · Explicitly NOT an official Google product; archival maintenance state (PyTorch 0.4-era deps).

Sources