Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Phillip has updated the leaderboard and surprisingly every new model release got substantially better, except for the OpenAi models. 6.2 Sol is 30th whereas 6.1 Sol is the 10th. Astra 6 is 9th, Astra 6.2 is 15th. By comparison Fable 5.2 became the 1st and Fable 5.1 is 7th. All the new google models, even hydrogen, are above the human baseline. By contrast, Astra 6 pro is the only openai model slightly above the human baseline at 8th place
 help



This is so strange. Perhaps it's recurrent depth. I don't think the new Anthropic models use it but GPT 6 does

Astra 6.2 is below Astra 6.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: