1.6T MoE, 48B active params/token, 30T+ token pre-training on 50,000 domestic accelerator cards.