Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

From the repo:

> Run LLMs locally on Cloud Workstations. Uses:

> Quantized models from [Huggingface]

> llama-cpp-python's webserver

But sure, the blog post doesn't mention it.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: