DeepSeek open-sources DeepInfer, the inference engine behind its production models
Photo: Crypto Briefing
The Chinese AI lab released its high-performance serving framework under Apache-2.0, alongside a token encoding tool called deepseek-recipe DeepSeek has open-sourced DeepInfer, the high-performance inference framework that runs its own models in production. The framework is built for DeepSeek models specifically. It powers the lab’s production-scale deployments, including DeepSeek-V4.1-Flash. DeepInfer bundles a set of optimizations aimed at making inference faster and cheaper to run. The toolkit includes custom kernels, distributed parallelism, speculative decoding and structured output support. Custom kernels are low-level routines written to squeeze more work out of specific chips.
Source: Crypto Briefing
