Hacker News new | past | comments | ask | show | jobs | submit login

> Anyone who can pay this, can run private tests and compare scores.

Yes, by uploading the tests to a server controlled by OpenAI/Anthropic/etc






These prompts are fielding millions of queries. The test questions are a small part of them. Further, the server doesn't know if it got the right answer or not, so it can't even train on them. Whereas in the arrangement with the testing companies before release, they can potentially do so, as the they are given the scores.



Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: