Unless I’m missing something, I believe all the big pieces are in place for just such a D&D game already, assuming one is starting with an environment and some key scenarios and virtual components and also a lot of great system prompt and trigger prompt sequences are programmatically in place and therefor every aspect is not autonomously generated. Stitching it all together would be an engineering and design challenge, but from the procedurally generated VR spaces I’ve seen and the recent advances with leveraging GPT-4 (among other models) for DM and NPC roles, I really do believe the core elements are in place. And I’d play the hell out of that game too!
