Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The whole point of this architecture is that it can also make use of multi-char patterns, but unlike BPE, they aren't hard-coded. And you can still use speculative decoding. Whether it works better or worse is something that you have to actually measure.
 help



Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: