Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

some support already merged, and I verified in a local build that it runs (cannot get MTP params working tho, about ~40 tok/s on my beefy 800GB/s 7900XT w/ 20GB VRAM). https://github.com/ggml-org/llama.cpp/pull/26841


Just tested muse-glimmer:30b-mlx on my laptop. Works great although a bit slow.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: