OPT-13B

OPT-13B is the 13B-parameter member of Meta's Open Pre-trained Transformer suite, released in May 2022 to give researchers full model access comparable to the GPT-3 class of models. Meta trained the OPT family to match GPT-3 performance while documenting data and training practices for reproducible research.

The weights are available to researchers but under a custom non-commercial license, not an open-source license, so commercial deployment is restricted. It was a foundational artifact for 2022-era open LLM research before the LLaMA generation arrived.