Benchmarking LLM Inference Back Ends: VLLM, LMDeploy, MLC-LLM, TRT-LLM, and TGI

[sherlockxu]

https://bentoml.com/blog/benchmarking-llm-inference-backends

[ssheng]

Hello! We're the authors of this blog post. Please let us know if there are other models and inference backends you'd like us to benchmark next.

[wey-gu]

Great work