Chinese artificial intelligence start-up DeepSeek has fully open-sourced an internally developed framework designed to run AI models efficiently, as a senior researcher at the company described the growing divide between open-source and closed-source AI as a battle between “light and darkness”.
The company on Tuesday released DeepInfer, an inference framework tailored to support its DeepSeek-V4.1-Flash model on both Nvidia’s SM100 Blackwell graphics processing units (GPUs) and Huawei Technologies’ Ascend 950 chips.
Inference refers to the serving and running of AI models, and frameworks such as DeepInfer help optimise that process.