Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I get about 50 t/s with the same model on a 3090, with about 100K context. I usually set harnesses to 90k.

It would be neat to also include NVFP4 variants for the Blackwell hardware.

 help



Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: