This project's been a blast to work with. While it's written in C++, it provides a C interface to compile against which makes it especially easy to extend with Go, Python and other runtimes.
A few folks and I have been building a tool with it in Go for pulling & running multiple models, and serving them on a REST API: https://github.com/jmorganca/ollama
In similar light, you haven't checked it out, llama.cpp also has a pretty extensive "server" tool (in its examples directory in the repo) with a web ui and support for grammar (e.g. forcing the output to be JSON)
> A few folks and I have been building a tool with it in Go for pulling & running multiple models, and serving them on a REST API: https://github.com/jmorganca/ollama
Why this tool was created? What was the reason for creating such tool? Why it was named this way?
Explanation for wishing to flag/block/bully basic simple questions:
Questions mean what they ask and nothing else. Any imagination of aggression or anything else related to emotions is misplaced.
As someone unfamiliar with the field I’ve read GitHub page and didn’t find answers to things I was curious about regarding this project.
So out of curiosity I wrote simple basic questions:
“Why this tool was created? What was the reason for creating such tool? Why it was named this way?“
Suggesting that if I didn’t figured it out by myself perhaps some one else who also wish to join the field and looking for entry point to try something in practice would also be confused and thus answering those simple basic questions would really help to the beginners.
With experience of entering into many new fields I know that usually there is a lot of confusion in the beginning about basic stuff .
I also suggested that those are obvious reasons why people ask questions and didn’t expect to be ‘bullied’ for basic simple questions. There were no one word of aggression in text. Perhaps seeing aggression there requires certain level of misplaced imagination.
Usually there is a fun story about the name for example GNU is Not Unix etc … This is opportunity to tell it if there is. Sometimes name holds some clue about functionality and then it’s easier to remember. Sharing it can help too to beginners.
As someone unfamiliar with the field I’ve read github page and didn’t find answers to things I was curious about regarding this project.
So out of curiosity I wrote simple basic questions:
“Why this tool was created? What was the reason for creating such tool? Why it was named this way?“
Suggesting that if I didn’t figured it out by myself perhaps some one else who also wish to join the field and looking for entry point to try something in practice would also be confused and thus answering those simple basic questions would really help to the beginners.
With experience of entering into many new fields I know that usually there is a lot of confusion in the beginning about basic stuff .
I also suggested that those are obvious reasons why people ask questions and didn’t expect to be ‘bullied’ for basic simple questions. There were no one word of aggression in text. Perhaps seeing aggression there requires certain level of misplaced imagination.
> Especially the one about the name, is the name offensive or what? To me it sounds quite benign.
So why the simple question doesn’t sound benign to you?
Usually there is a fun story about the name for example GNU is Not Unix etc … and sometimes it holds some clue about functionality and then it’s easier to remember.
Usually friendly advice is given after friendly answering question, which was not demonstrated here.
We are perfectly aware of how to deal with extra-sensitive people and kind approach is the way to go. However on this site I expect certain level of technical training and intelligence in answering direct questions without being offended by search for a deeper understanding of some topic and without inventing emotions that never been there in the first place. I was also under impression that guidelines of this site directly where encouraging answering I expect by declaring : “be kind” “don’t be rude” “suggest a good faith” and unfortunately none of those were demonstrated by your answers even when you have learned the fact that you were wrong and your accusations were completely ungrounded . The fact that such behaviour was encouraged by (as you claim it) “multiple people” including moderation of this site tells a very sad story about this site regarding following own declared principles.
And this example:
“Which crypto? Where can I pay with it? What if I don't want to have a hardware wallet everywhere with me? Can I cancel transactions and get my money back? Does it use more energy per year than Argentina?” (https://news.ycombinator.com/item?id=36656667)
tells another sad story about hypocrisy which means it’s hard to take “friendly“ advice seriously. The next time you wish to give a truly friendly advice try to be kind in the first place, do not suggest a bad faith and do not insist on false ungrounded accusations encouraged by confirmation biases especially when clarification presented.
You could have just apologise for own real aggression contrary to imaginative aggression from my questions and simply give answer while keeping “friendly” advice to yourself.
This way people would learn something about the project rather than learning something about cancelling “culture” which is under the flag of “being nice” demonstrates much worse behaviour in practice than one it claim to oppose. You actually among others should be very aware and disgusted by those tactics after you’ve seen effects of “soviet methods” in Romania.
A few folks and I have been building a tool with it in Go for pulling & running multiple models, and serving them on a REST API: https://github.com/jmorganca/ollama
In similar light, you haven't checked it out, llama.cpp also has a pretty extensive "server" tool (in its examples directory in the repo) with a web ui and support for grammar (e.g. forcing the output to be JSON)