Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Open-source algorithm? No.

The publish their algorithms just fine and no one has had issues replicating their work.



Where's the ChatGPT paper?


From the ChatGTP announcement: "ChatGTP is a sibling model to Instruct GPT"

The paper for that is linked from https://openai.com/research/instruction-following


The InstructGPT paper only explains the RLHF part of how ChatGPT works. There's reason to believe that isn't enough to achieve ChatGPT's performance and behaviour (e.g. [1]). There are other components that make ChatGPT more powerful, and OpenAPI is not being open about them.

[1] https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr...


I don't think that conclusion is clear at all. Indeed your own link has things they thought were unclear struck and and parts of the InstructGPT paper that explains them inserted.

They do have newer models that aren't generally available that are different though.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: