On: DeepInfer: High-performance inference framework for DeepSeek models

[JacobAsmuth]

Well except that baseten serves deepseek faster than this already at a lower price. So this seems to mostly help startup inference providers that don't have their own inference engines.

[shafyy → JacobAsmuth]

Is it only faster or also higher quality (whatever that means haha)?