DeepSeek's DeepInfer Supports NVIDIA GPUs and Huawei NPUs
Photo: TokenPost
DeepSeek's open-source DeepInfer framework supports NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, while companion software handles API requests, giving developers hardware options for running DeepSeek-V4.1-Flash. DeepInfer currently supports only DeepSeek-V4.1-Flash. Its features include expert parallelism, structured outputs and DSpark, which uses draft tokens to speed up response generation. Deterministic sampling, designed to produce the same result from the same input, is available only on NVIDIA hardware. DeepSeek also released deepseek-recipe, a collection of Rust libraries and Python bindings. It converts API requests into model prompts and processes responses, helping developers align their deployments with DeepSeek's API behavior.
Source: TokenPost
