TowerInstruct 13B

TowerInstruct 13B is Unbabel's instruction-tuned translation specialist, released in January 2024 as the 13B member of the Tower family. Built by continued pretraining of Llama 2 on 20B tokens of multilingual and parallel data followed by instruction tuning on the TowerBlocks dataset, it handles translation, automatic post-editing, grammatical error correction, and named entity recognition across 10 languages.

The accompanying paper reports TowerInstruct beating open alternatives on translation quality and competing with closed models of its era. Note the release license: Tower models were published under a non-commercial Creative Commons license, so commercial users need to check current terms or Unbabel's commercial offerings.