On: Llama2.c: Inference llama 2 in one file of pure C

[kgwgk]

Would you say that running on bare metal the huggingface.co libraries - as the comment that I replied to suggested - is pretty simple?

[immibis → kgwgk]

It doesn't use the huggingface.co libraries?

[kgwgk → immibis]

lachlan_gray asked whether anyone has got a LLM to run on bare metal.

tomrod replied to lachlan_gray that the huggingface.co libraries make it pretty simple.

I pointed out to tomrod what is the meaning of the expression “bare metal”.

I don’t understand what’s the point of your reply to me in that context.

[tomrod → kgwgk]

I can't speak for the p___g contest others want to engage in, but why not, lets make bare metal LLMs happen!

https://github.com/rreilink/PiPyOS <-- seems like a good starting point, bare metal python.

I appreciate the clarification earlier in the comment chain for what you meant by bare metal -- I had interpreted it as on-prem.

[kgwgk → tomrod]

I didn’t know that there was a bare metal implementation of python, thanks for the link. I doubt it can run pytorch though.

[tomrod → kgwgk]

As with all things, the key word is "yet" :)