On: I Self-Hosted Llama 3.2 with Coolify on My Home Se...

[segalord]

I use it exclusively for users on my personal website to chat with my data. I've given the setup tools to have read access my files and data

[netdevnet → segalord]

Is this not something that you can with non-hosted LLMs like ChatGPT? If you expose your data, it should be able to access it iirc

[worldsayshi → netdevnet]

You can absolutely do that but then you pay by the token instead of a big upfront hardware cost. It feels different I suppose. Sunk cost and all that.