Grok Weights Available via Torrent

[kaliqt]

https://twitter.com/grok/status/1769441648910479423

[ronsor]

It's a 314 billion parameter mixture-of-experts, apparently trained using a custom framework using Rust and Jax.

[ls612 → ronsor]

So this isn't something anyone without H100s is ever running no matter how you quantize it.

[rvz]

As promised, weights are available. For those who don't like Twitter / X, Here are the details from the README:

- 314B parameter Mixture of Experts model

- Base model (not finetuned)

- 8 experts (2 active)

- 86B active parameters

- Apache 2.0 license

- Code: https://github.com/xai-org/grok

- Weights: https://github.com/xai-org/grok?tab=readme-ov-file#downloadi...

Even more open than OpenAI.

[permalac → rvz]

How many H100 does one need to run this?

[sp332 → permalac]

8.

[permalac → rvz]

How many H100 does one need to run this?

[sp332]

Bold to make a joke about the tsunami of spam overrunning the site.

[ChrisArchitect]

Some more discussion: https://news.ycombinator.com/item?id=39737281

[kaliqt]

They made good on their promise it would seem.