Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I only get ~4 tok/sec on a M1 Pro with MTP.


I get ~10 tok/sec on a M1 Ultra, but the real issue is abysmal prompt processing which makes it unusable. On the M1 and M2 series MTP is actively harmful for performance.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: