My benchmark for large language models

[cheviethai123]

https://nicholas.carlini.com/writing/2024/my-benchmark-for-large-language-models.html

[cheviethai123]

Consider how low the score of Gemini here compared to the other LLM test. And I'm impressed by the evaluation method's ability to assess performance without relying on tailored prompts.

[hoamatcuoi → cheviethai123]

But the benchmark only scoring Gemini-Pro 1, I'm curious how the Gemini Ultra performance here but guessed we couldn't know yet.