On: We ran AI agent swarms in Minecraft and Mindustry

[ansipunk]

It is impressive, but it is also a display that LLMs are simply not suited for this, there's way too much latency. Obviously, a more specialized neural network would be much better, but would you believe this:

In 2017, OpenAI presented the first version of their program that plays Dota 2, a very complex, fast MOBA with endless mechanics and defeated one of the world champions in a one-on-one match. Next year, they showed the world OpenAI Five, a version of the program, that runs a full five player team of those bots and they managed to defeat a full team of world champions in 2019. They ran an event where the bots would play for 4 days straight and they won 99.4% of 42,729 matches.

https://en.wikipedia.org/wiki/OpenAI_Five

[jackgolding → ansipunk]

What some people do on the rs-sdk runescape server is Jev + deterministic scripts + orchestrating with Astra

[josefx → ansipunk]

> They ran an event where the bots would play for 4 days straight and they won 99.4% of 42,729 matches.

Of course they also flat out disabled any mechanic their AI hadn't mastered.

[ansipunk → josefx]

I don’t think they did. If I remember correctly, the only limitation they have introduced was the available playable character pool.

[josefx → ansipunk]

At least some of the articles linked by that wikipedia page still listed various things like summons, divine rapier and illusions as disabled.

[niltecedu → josefx]

That was the first version they imrpvoed after that

[josefx → niltecedu]

That was from an article covering the last public event mentioned by Wikipedia. Do you have any more recent sources?

[ansipunk → josefx]

Oh, my bad then.

[ansipunk → ansipunk]

Moreover, in their private training sessions, their models played cumulatively about 180 years worth of games, so I doubt there were many mechanics left to be mastered.

[armchairhacker → ansipunk]

And CNN for image recognition? It’s (similar to) what the human brain uses.

[ansipunk → armchairhacker]

No image recognition, the bot gathers info about the game from Dota's developer API. Which, to be fair, is a massive advantage, but it, in my opinion, doesn't make the achievement any less.

[tonyhart7 → ansipunk]

but that is not LLM (Transformer), its LSTM

[ansipunk → tonyhart7]

That's what I said in my comment, that LLM is just not what you want for such a task.

[busssard → ansipunk]

depends, for mindustry yes.

But if you look at minecraft interacting with other Humans in an Environment where there is no winning requires some part that is capable of natural Language.

Also it is more an interesting way to see how different architectures behave