Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

Summarized by the Neuricon wire. Every claim links back to its primary source where available.