Hacker News new | past | comments | ask | show | jobs | submit login

What is the advantage of this versus running something like https://github.com/simonw/llm , which also gives you options to e.g. use https://github.com/simonw/llm-mlc for accelerated inference?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: