Noor 10B

Noor 10B was the world's largest Arabic natural language processing model at its launch in April 2022, developed by Abu Dhabi's Technology Innovation Institute with LightOn. The decoder-only Transformer, similar in structure to GPT-3, was trained on a purpose-built corpus of more than 30 billion Arabic words spanning web data, books, poetry, news articles and technical information.\n\nTraining ran on 128 A100 GPUs with state-of-the-art 3D parallelism, and the project pioneered ML-based data filtering pipelines for Arabic at scale. Noor was aimed at academicians and businesses as a go-to exploration model for generative Arabic tasks.\n\nNoor is primarily a historical milestone in sovereign-language AI rather than a currently maintained open model; weight availability has been research-oriented rather than broadly public, so treat it as a reference entry for Arabic LLM history.