Microsoft finishes pre-training MAI-Base-2, its next in-house foundation model

The successor to MAI-Base-1 has cleared its most compute-heavy phase as Microsoft builds out its own AI stack Microsoft has finished pre-training MAI -Base-2, the next foundation model from its in-house AI group. Pre-training is the most compute-intensive stretch of building a large language model. It produces the raw intelligence, not the polished product, and it signals that Microsoft’s homegrown AI effort is moving into its second generation. Think of pre-training as a model’s undergraduate degree. It reads a vast library of text and learns to predict what comes next, picking up grammar, facts and patterns along the way.

Source: Crypto Briefing