Hacker News new | past | comments | ask | show | jobs | submit login

I'm using mixtral-8x7b-v0.1.Q4_K_M.gguf with llama.cpp and it only requires 25GB.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: