Hacker News new | past | comments | ask | show | jobs | submit login

This argument ignores scaling laws





It really doesn't lol. Those laws are like Moore's law, an observation rather than something Fundamental like laws in physics

The scaling has been plateauing, and half that equation is quality training data which is totally out at this point.

Maybe reasoning models will help produce synthetic data but that's still to be seen. So far the only benefit reasoning seems to bring is fossilizing the models and improving outputs along a narrow band of verifiable answers that you can do RL on to get correct

Synthetic data maybe buys you time, but it's one turn of the crank and not much more




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: