Moonshot AI's Kimi K3.1 Pro Deployed on AMD Instinct MI355X GPUs

Moonshot AI has announced the deployment of its latest multimodal AI model, Kimi K3.1 Pro, on AMD Instinct MI355X GPUs. The model, which features 2.8 trillion total parameters and 104 billion activated parameters, is designed to handle complex AI tasks with a one-million-token context window. This deployment leverages AMD's ATOM inference engine and vLLM for optimized performance and scalability. Kimi K3.1 Pro retains the hybrid architecture of its predecessor, Kimi K3, with 69 Kimi Delta Attention (KDA) layers and 24 latent-attention layers.

Source: Blockchain.News