On: OpenAI and Microsoft Azure to deprecate GPT-4 32K

[xena]

One of the decent parts about open weights models is that you can't have this happen to you. You get to keep access to any model you want. This is essential for continuity of products.

[MuffinFlavored → xena]

what is chatgpt as a product more than just “really good weights”?

[TeMPOraL → MuffinFlavored]

It's just really good weights - significantly better weights than anyone else has.

[MuffinFlavored → TeMPOraL]

why has nobody else been able to catchup/come close?

[xena → MuffinFlavored]

Really good weights that you don't have to run yourself

[astromaniak → MuffinFlavored]

good weights are the key, but it has python interpreter and bing search. and likely more in development.

[BiteCode_dev → MuffinFlavored]

Probably a lot that we don't know about, because ChatGPT has better reasoning skills than most other systems out there, and we know reasoning is not really about the weights.

[Slyfox33 → BiteCode_dev]

Chatgpt can't reason about anything.

[astromaniak → Slyfox33]

it can pretend, which often looks indistinguishable. so that you can't say if it's real or not.

[astromaniak → xena]

just wonder, do you know any opens source LLM? that can be reproduced?