The one thing that really surprised me yesterday was when OpenAI Five seemed to pause the game. The commentators speculated that “it was learning” because the humans had paused in game 1 due to lag.
I assume that’s not right, as OpenAI five is not training itself as it’s playing (wouldn’t make much sense to add one more game sample to the billions it has already trained on).
I thought it was interesting that the commentators had this misconception, and was wondering what lead to OpenAI Five hitting pause.
A network blip caused all the players to drop from the game.
Incidentally, we'd just changed the code a few days earlier from "automatically surrender when a human disconnects" to "do nothing if a human disconnects; automatically pause if all humans disconnect". Had done a lot of advance planning for what might break!
Off the tangent question here -- Do you have any plans to pit OpenAI Five against the winners of this year's 'The International 8' tournament scheduled for later this month?
Folks in the DotA 2 community are going crazy over this possibility, would be incredible if this happens.
Looks like they are at least playing pros from TI8[0].
[0]: "These results give us confidence in moving to the next phase of this project: playing a team of professionals at The International later this month." from https://blog.openai.com/openai-five-benchmark-results/ at the bottom
Regarding the commentators, I saw that part and took it as them having fun with the situation, not really making a statement about how the technology works. Esports commentators tend to be more jokey/entertaining than traditional sports in my experience.
The one thing that really surprised me yesterday was when OpenAI Five seemed to pause the game. The commentators speculated that “it was learning” because the humans had paused in game 1 due to lag.
I assume that’s not right, as OpenAI five is not training itself as it’s playing (wouldn’t make much sense to add one more game sample to the billions it has already trained on).
I thought it was interesting that the commentators had this misconception, and was wondering what lead to OpenAI Five hitting pause.