WizardCoder-34B-Python surpasses GPT-4 on HumanEval | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

		WizardCoder-34B-Python surpasses GPT-4 on HumanEval (twitter.com/wizardlm_ai)
		3 points by Xeophon on Aug 26, 2023 \| hide \| past \| favorite \| 1 comment

ilaksh on Aug 26, 2023 [–]

Except it doesn't. They even mention in the same Tweet that their own test showed 82 percent for GPT-4.

But if CodeLlama can make that claim then I guess it's fair for WizardCoder to say it also.

Wherever the old number is coming from.shouod be updated.

Consider applying for YC's W25 batch! Applications are open till Nov 12.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact