Meditron-70B

Meditron-70B is an open medical large language model from EPFL, released in late 2023. It adapts the Llama 2 70B backbone through continued pretraining on a curated medical corpus drawn from clinical guidelines and medical literature, then fine-tunes it for medical question answering.

At release it was positioned as the largest openly available medical LLM, and it became a reference point for the debate over whether continued pretraining on domain data beats generalist models on medical benchmarks.

Meditron is derived from Llama 2 and carries the Llama 2 community license lineage, which includes use restrictions that differ from standard open-source licenses. Anyone deploying it beyond research should review the exact terms on the release page.