On: Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook

[antimatter15]

It reworks the interactive mode into a chat interface, which -if my code was cleaner- could have just been a pull request.

[doctoboggan → antimatter15]

There is an interactive mode in llama.cpp

https://github.com/ggerganov/llama.cpp/blob/master/main.cpp#...

EDIT: I see now you are saying you re-worked the existing interactive mode. I still think your changes could be a PR into the original repo

[ggerganov → antimatter15]

"Clean Code, Horrible Performance" :)