Hacker News new | past | comments | ask | show | jobs | submit login




LiteLLM seemed to be the best approach for what I needed - simple integration with different models (mainly OpenAI and the various Bedrock models) and the ability to track costs / limit spending. It's working really well so far.


Didn't know about LiteLLM. That seems to be the right kind of middleware most people would need, instead of Langchain.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: