On: The Leaderboard Illusion

[amelius]

Maybe there should be some rate limiting on it then? I.e., once a month you can benchmark your model. Of course you can submit under different names, but how many company names can someone realistically come up with and register?

[sebastiennight → amelius]

So now you want OpenAI to go even wilder in how they name each new model?

[amelius → sebastiennight]

1 model per company per month, max.