Microsoft Completes Pretraining of 2.8 Trillion-Parameter MAI-Base-2
Photo: TokenPost
Microsoft announced Oct. 15 that it had completed pretraining MAI-Base-2, a 2.8 trillion-parameter model, after a 38-day run on 16,000 NVIDIA GB200 GPUs, moving it into post-training. The training campaign ran during August and September 2026. MAI-Base-2 has 80 billion active parameters, and its full parameter count is 2.8 trillion. Its knowledge cutoff is March 2026. The training mixture contained 50 trillion tokens, with vision-language data accounting for 18%. That share represents 9 trillion tokens in the mixture; the vision-language corpus contained 4.5 trillion unique tokens. The model was pretrained natively with vision.
Source: TokenPost
