benryanx's comments

On: Show HN: PureBee – A software-defined GPU running Llama 3.2 1B at 3.6 tok/SEC

[benryanx]

That's the postMessage bottleneck - PR #1 replaces it with Atomics-based dispatch which should push utilisation much higher. Early numbers look like 6.4 tok/sec on M2 Max

On: Show HN: PureBee – A software-defined GPU running Llama 3.2 1B at 3.6 tok/SEC

[benryanx]

The part I'd point people to first is ARCHITECTURE.md — specifically the WASM binary construction section. Every other CPU inference project I know of uses Emscripten or a compiled Rust backend. PureBee builds the binary in JavaScript. That's the thing I'd most want challenged if I'm wrong about it being novel.