On: Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

[gitpusher42]

Thank you! Under good conditions it achieves approx a 67% cache hit rate with 16 expert slots

[WithinReason → gitpusher42]

That's great, now I wonder how cache hit rate scales for larger models. Do you have any plans trying Qwen 3.6 or larger?

[gitpusher42 → WithinReason]

Check for colibri, dwarf star and flash-moe. they do similar things with bigger models

https://github.com/JustVugg/colibri https://github.com/antirez/ds4 https://github.com/danveloper/flash-moe