On: Show HN: BrowserAI – Run LLMs directly in browser using WebGPU (open source)

[Philpax]

This is a wrapper around WebLLM [0] and transformers.js [1]. What exactly are you offering on top of those two libraries?

[0]: https://github.com/mlc-ai/web-llm [1]: https://huggingface.co/docs/transformers.js/en/index

[sauravpanda → Philpax]

This is the start so yes at the current state, we aren't offering much, if you check the GitHub repo, we don't directly use Transformers.js but have forked their code to ts and removed things that caused build issues in some frameworks like next, etc due to node modules.

We are adding features like RAG and observability integrations so people can use these llms to perform more complicated tasks!