My takeaway from this kind of thing is that it demonstrates what OpenAI has accomplished as far as managing to be so much "smarter" on average, or even when compared to what Google has available.
My guess is that the amount of RLHF they have done is much more than any other project.
My guess is that the amount of RLHF they have done is much more than any other project.