Open SourceLatent Space

[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback

#deepseek#inference#open-source#ai#technology

English

DeepSeek has released DeepInfer, an open-source inference engine capable of processing 155 trillion tokens per day with a reported revenue of $22 million daily at an 80% margin. The system supports distributed inference and includes features like prompt caching, though not all components are fully open-sourced yet.

中文

DeepSeek发布了DeepInfer，这是一个开源推理引擎，能够每天处理155万亿个令牌，报告的日收入为2200万美元，利润率为80%。该系统支持分布式推理，并包括提示缓存等功能，但并非所有组件都已完全开源。