Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
NVIDIA and AI4Bharat release Nemotron-pretraining-Indic-v1, a 2.8-trillion-token synthetic corpus covering 22 Indian languages, alongside an open GPU-accelerated pipeline for translation, quality assessment, and repair.