Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> ... the target size for the new model is 1 trillion parameters.

> Meanwhile, the target size for the free & public versions of ChatGPT is just 175 million in comparison. That's a 5.7x increase in number of the parameters.

5.7x seems off by several orders of magnitude, or do I need more caffeine?



It's a typo in the article. GPT-3.5 is 175bn parameters, not 175 million.

GPT-4 does not have publicly available parameter count, but is thought to have something similar to 1tn.


Cool, thanks. :)




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: