RTLCoder
Open Verilog generation that beats GPT-3.5: HKUST's automated data pipeline plus a quality-feedback training loop.
About
RTLCoder is an open-source Verilog RTL generation project from HKUST that set a new bar for non-commercial hardware design models. Its core contribution is an automated flow that generates a large labeled dataset of Verilog design problems and answers, addressing the severe data shortage for chip-design tasks, plus a training scheme driven by code-quality feedback that pushes the model past plain fine-tuning. The team released four models, including RTLCoder-Deepseek-v1.1 (a DeepSeek-Coder-6.7B fine-tune, the strongest) and RTLCoder-v1.1 (Mistral-based), along with GPTQ and GGUF quantized builds.
The authors claim the quality-feedback training lifts the models above GPT-3.5 on the VerilogEval and RTLLM benchmarks. Everything is open: the data generation flow, the training data, the training code, and the models. For hardware teams that need RTL generation without sending proprietary designs to a commercial API, it is the most practical open option in its class.
Specs
Context window
Pricing
Free quota
API access
Weights
Released
Benchmarks
- VerilogEval and RTLLM: best variant (RTLCoder-Deepseek-v1.1) claimed to outperform GPT-3.5 (provider-reported, repo)
- Independent RTL-Repo eval includes RTLCoder alongside GPT-4, Starcoder2, and VeriGen
Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.
Use cases
Trust score — 6/10
Scored 6/10 (metrics tier, metrics-v1). Evidence: published paper (arXiv:2312.08617) with the data-generation flow, training data, and four models all released; cited by the independent RTL-Repo benchmark. Strengths: fully open pipeline including data, quantized CPU builds. Docked for: (1) the GPT-3.5 comparison is author-run with no third-party replication surfaced; (2) license terms for the weights were not stated in the materials surfaced — verify before commercial use.
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 6.0/10
- Maintenance · recency, releases, issue load
- 5.0/10
- Openness · license + docs
- 8.0/10
- Manual review · sanity read + red-flag check
- 6.0/10
- · Paper + data-generation flow + training data + 4 models all released
- · GPT-3.5 comparison is author-run; weight license unstated