ToolLostRuins (community)/10 trustVerified
KoboldCpp
Single-binary local LLM runtime — GGUF models, API included.
About
KoboldCpp (LostRuins/koboldcpp, AGPL-3.0, ~12k stars) is the single-binary local LLM runtime: run GGUF models with a built-in API and web UI — no Python environment needed.
Actively maintained (23 releases/12mo). AGPL-3.0 copyleft — fine for personal/local use. The easiest way to serve a local model.
What it can do
- Single binary
- GGUF models
- Built-in API + UI
- No Python needed
- AGPL-3.0
Setup
- Download the binary for your OS.
- Point it at a GGUF model file.
- Use the web UI or the API.
Prerequisites
A GGUF model file; enough RAM/VRAM.
Use cases
chatcode
Works with
Generic APIAny agent (.md)
Trust score — 8/10
/10 trustVerified
Scored 8/10 (verified tier). ~12k stars, actively maintained, the simplest local-LLM runtime. Docked for AGPL copyleft (flagged). Verified tier.
★ 11,990 GitHub stars
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 7.7/10
- Maintenance · recency, releases, issue load
- 8.2/10
- Openness · license + docs
- 9.1/10
- Manual review · sanity read + red-flag check
- 7.0/10
- · 11,990 GitHub stars (log-scaled vs catalog peers)
- · last push 1d ago; 23 releases/12mo; 532 open issues
- · manual review: KoboldCpp — single-binary local LLM runtime; AGPL copyleft flagged; active; license: AGPL-3.0 (copyleft)
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.