Skip to content
← Models
Open weightsUniversität Hamburg (UHH) Signal Processing group/10 trustVerified

SGMSE

Diffusion-based generative speech enhancement and dereverberation — learns to reverse a noise process on the complex spectrogram instead of masking it.

Visit official page →

About

SGMSE takes a different bet from the masking crowd: it treats enhancement as generation. A score-based diffusion model (an NCSN++ score network over the complex STFT) learns to reverse a stochastic process that starts at the noisy spectrogram and ends at clean speech, iteratively denoising over reverse-diffusion steps. The first version appeared at Interspeech 2022, followed by the SGMSE+ journal paper in TASLP 2023 extending it to joint enhancement and dereverberation, plus an ICASSP 2023 analysis comparing generative against discriminative approaches. The Hamburg group ships the official PyTorch implementation with pretrained checkpoints under MIT, and the same codebase underpins their EARS fullband benchmark dataset work. The cost of the generative approach is speed: iterative sampling is far slower than a single mask pass, so this is an offline or research model rather than a real-time one. Author-reported quality is competitive with the best discriminative models, and generative methods have a documented edge on badly degraded inputs where masking leaves artifacts. Independent replication is limited, which keeps the score honest.

Specs

Context window

Not applicable — noisy utterance in, iteratively sampled clean spectrogram out (offline, multi-step diffusion)

Pricing

Free / open release

Free quota

Fully open — no API, self-host

API access

No hosted API — self-host the MIT-licensed PyTorch code with published checkpoints (enhance_file.py)

Weights

Open weights

Released

Not disclosed

Benchmarks

  • Papers (Interspeech 2022 / TASLP 2023, author-reported): competitive with state-of-the-art discriminative enhancers on enhancement and dereverberation; authors report generative models degrade more gracefully on severe corruption
  • No independent benchmark replication found

Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.

Use cases

speech-enhancementdereverberationaudio-restorationresearch-baseline

Trust score — 7/10

/10 trustVerified

Scored 7/10 (TIER verified, metrics-v1). Evidence: peer-reviewed Interspeech 2022 + TASLP 2023 papers from UHH; official MIT-licensed code with pretrained checkpoints (774 GitHub stars); the group's EARS benchmark keeps the line honest. Strengths: genuinely different and principled generative approach, joint enhancement and dereverberation, open weights. Docked for: (1) iterative diffusion sampling is slow — no real-time use; (2) all quality numbers are author-reported. License: MIT.

How the trust score is built

Full methodology →
Adoption · stars/downloads, log-scaled vs peers
7.0/10
Maintenance · recency, releases, issue load
6.0/10
Openness · license + docs
9.0/10
Manual review · sanity read + red-flag check
7.0/10
  • · UHH Signal Processing group; sp-uhh/sgmse repo created 2022-08-10, ~770 stars
  • · Interspeech 2022 + TASLP 2023 (SGMSE+): score-based diffusion on the complex STFT for enhancement and dereverberation
  • · Iterative sampling is slow — offline/research use; underpins the group's EARS fullband benchmark

Sources