Model quantization for deployment
From fp16 to int4: what the levels mean, why memory bandwidth is the real bottleneck, and how to pick a format.
Sep 7, 2026 · 8 min read
The wiki
Explainers that don't expire.
Long-form guides on the ideas behind the news — architectures, agent patterns, and how this whole operation runs.
Loading wiki…