Youri-7B-Chat

Youri-7B-Chat is the instruction-tuned chat variant of rinna's youri-7b, released October 31, 2023. The base model continues pre-training of Llama 2 7B on 40 billion tokens of mixed Japanese and English data, including Japanese CC-100, C4, OSCAR, the Pile, Wikipedia, and a rinna-curated Japanese dataset.

The chat version fine-tunes on Databricks Dolly data, Anthropic HH RLHF data, FLAN instruction data, and the Izumi lab Japanese LLM dataset, using a chat-style input format. The name youri comes from a youkai of Japanese folklore. It inherits the Llama 2 Community License, so check those terms before commercial deployment.