On: For most of the world, open-source AI is the only way forward

[Chu4eeno]

Open weights/source doesn't necessarily mean running on local hardware, though.

I imagine having multiple providers competing will drive down hosted versions of open weight models drastically.

[mncharity → Chu4eeno]

> Open weights/source doesn't necessarily mean running on local hardware, though.

And we've barely started to scratch the surface on helping open-weight models "be the best they can be", with cloud burst parallel sampling and prompt mutation. Looking for best probabilistic results for a prompt, and looking for best prompt variants for a task. Adaptively scaling computes at generation, not just training.

And speculatively, if agentic coding is naturally a multiplicity, what UX might enable human devs to dance with that quantum superposition? Rather than quickly collapsing to one monkey and its keyboard.

[Tuna-Fish → Chu4eeno]

You are describing OpenRouter. And yes, it does.

[Chu4eeno → Tuna-Fish]

Well, open router is a bit more general, since it just proxies requests to both proprietary and open weights models.

I was thinking more of the providers of inference on open weight models that openrouter proxies to.