Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Half of the benchmarks don't have published answers. That's why training data providers have been hiring physicists to solve them.


This is unconventional benchmaxxing then, when they decrease the benchmark scores to allow models to generalize on correct solutions.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: