•SiTech AI Team
NVIDIA and IIT Madras Release 2.8 Trillion Token Indic Pretraining Corpus
NVIDIA, IIT Madras and AI4Bharat are releasing Nemotron-pretraining-Indic-v1, a corpus of about 2.8 trillion tokens across 22 Indian languages, along with the open GPU-accelerated pipeline used to generate it.