Hacker News new | past | comments | ask | show | jobs | submit login

I use a combination of the crewAI python library, chromaDB as a vector database, and I run an embedding and llama model out of an Ollama docker container. This is all running and hosted locally on my personal PC and running off a 12GB RTX3060. I had to customize some of the tooling that comes with crewAI to make the RAG retrieval tool they provide work with my local chromaDB and Ollama models.

They have a nice class setup that lets you build fully custom tooling, really fun playing with the Selenium webdriver library and give your agents tooling to interact and observe web elements.

Huggingface recently released their smolagents framework as well, I might start looking into that.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: