Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

yes, but it uses 17gb VRAM when running a 50 inference steps generation from prompt. Which is more than I expected since a 7B model sounds little.


Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: