On: Dessa: Conversation Model trained only on speech

[bm-rf]

Do you think that, much like how OpenAI scaled up GPT-2 to GPT-3, someone else can train a larger model like Dessa on, say, multiple GB200s?

[WhitneyLand → bm-rf]

Yes, most likely. The problem is even if it’s better it has to be super fast/real time to be convincing. That’s the part I think could take a few more hardware generations.