Edit: I can't add any further replies I guess becase this was flagged, but it seems that gpt-3.5-turbo-instruct is a real thing, I got an email about it. This was one of the links in the email so I see how this mistake was made
> InstructGPT is better than GPT-3 at following English instructions.
EDIT: Color me dumb. It's an old article.
An interesting thing to note is what damage was done to the model's intelligence when we did this. That shows up in the GPT-4 release docs https://openai.com/research/gpt-4:
> Interestingly, the base pre-trained model is highly calibrated (its predicted confidence in an answer generally matches the probability of being correct). However, through our current post-training process, the calibration is reduced.
I wonder if it was the instruction tuning or the safety stuff that lobotomized it.