DeepSeek open-sources DeepInfer, the inference framework behind its production services

Chinese artificial intelligence startup Hangzhou DeepSeek Artificial Intelligence Basic Technology Research Co. Ltd. today open-sourced DeepInfer, the inference framework behind its own production services. The release takes on the cost of serving large models to the public. DeepSeek calls reaching a massive user base at a reasonable price “the core problem an inference framework has […] The post DeepSeek open-sources DeepInfer, the inference framework behind its production services appeared first on SiliconANGLE.