Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Because it's easier to pull off and experiment with it from ollama (ollama is just go wrapper around llama.cpp).

Llama.cpp could have upstream support for it but for them to consider it will have to be ironed out idea.

In llama.cpp support may have some different, more low level kind of support, I don't think it makes sense to attach state logic to text input there.



Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: