On: GGML – AI at the Edge

[ignoramous]

Can LLaMA be used for commerical purposes though (might limit external contributors)? I believe, FOSS alternatives like DataBricks Dolly / Together RedPajama / Eluether GPT NeoX (et al) is where the most progress is likely to be at.

[detrites → ignoramous]

May also be worth mentioning - UAE's Falcon, which apparently performs well (leads?). Falcon recently had its royalty-based commercial license modified to be fully open for free private and commercial use, via Apache 2.0: https://falconllm.tii.ae/

[mistercow → detrites]

Hugging Face has a demo of the 40B Falcon instruct model: https://huggingface.co/blog/falcon#demo

It’s pretty good as models of that size go, although it doesn’t take a lot of playing around with it to find that there’s still a good distance between it and ChatGPT 3.5.

(I do recommend editing the instructions before playing with it though; telling a model this size that it “always tells the truth” just seems to make it overconfident and stubborn)

[samwillis → ignoramous]

Although llama.cpp started with the LLaMA model, it now supports many others.

[_fjb4 → ignoramous]

OpenLLAMA will be released soon and it's 100% compatible with the original LLAMA.

https://github.com/openlm-research/open_llama

[okhuman → ignoramous]

This is a very good question that will be interesting how this develops. thanks for posting the alternatives list.

[chaxor → ignoramous]

Why is commercial necessary to run local models?

[ignoramous → chaxor]

It isn't, but such models may eventually lag behind the FOSS ones.