Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
jakswa
26 days ago
|
parent
|
context
|
favorite
| on:
Muse Glimmer: 30B-parameter model optimized for al...
some support already merged, and I verified in a local build that it runs (cannot get MTP params working tho, about ~40 tok/s on my beefy 800GB/s 7900XT w/ 20GB VRAM).
https://github.com/ggml-org/llama.cpp/pull/26841
bwfan123
26 days ago
[–]
Just tested muse-glimmer:30b-mlx on my laptop. Works great although a bit slow.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: