On: OpenAI says it has evidence DeepSeek used its mode...

[awestroke]

No. They publish PDFs that hype up their models, but they do not publish anything even resembling a high-level overview of model architecture

[jacobgorm → awestroke]

Given that you can download and use the weights, the model architecture has to be includded as part of that. And I did read a paper from them recently describing their MoE architecture and how it differs from the original GShard.

[awestroke → jacobgorm]

Excuse me? What weights can you download from OpenAI? gpt2 does not count

[jacobgorm → awestroke]

Sorry I meant that DeepSeek release their models. Wrong context.