Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The problem is that it's too expensive. It can technically do parts of my job for me, but at a variable cost that's higher than mine right now.
 help



Efficiency is an angle of research that's quite active, see quantization, MoE, speculative decoding, QKV cache optimizations, sparse attention, etc



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: