Hacker Newsnew | past | comments | ask | show | jobs | submit | fromlogin
Reuse non-prefix KV Cache and speed up RAG by 3X with LMCache (github.com/lmcache)
5 points by lihanc111 17 days ago | past | 1 comment
Lossless LLM 3x Throughput Increase by LMCache (github.com/lmcache)
154 points by lihanc111 32 days ago | past | 53 comments
LMCache: Redis for LLMs (github.com/lmcache)
7 points by handfuloflight 38 days ago | past

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: