I didn’t seek out the video before, I read about all the glaring problems, but one thing that no one pointed out was… why is the entire thing slow motion?
Like, you know Doom? The game where the brisk pace and constant movement are a core part of its DNA? Witness it running at 0.5x speed and like 5FPS in the year of our acausal robot lord 2024.
It’s running slow because it’s running at such a low framerate. The speed and the framerate are tied. Old console games used to work that way, which was a problem because games would run at different speeds in different countries (PAL vs NTSC). This is a solved problem in modern games. Just separate the game logic from the display logic. But this AI can’t do that because there is nothing but the video.
Add to that that the AI was probably trained on high framerate footage but is only capable of generating low framerate footage and you get (gestures wildly) this
Skimmed the paper, but i don’t see the part where the game engine was being played. They trained an “agent” to play doom using vizdoom, and trained the diffusion model on the agents “trajectories”. But i didn’t see anything about giving the agents the output of the diffusion model for their gameplay, or the diffusion model reacting to input.
It seems like it was able to generate the doom video based on a given trajectory, and assume that trajectory could be real time human input? That’s the best i can come up with. And the experiment was just some people watching video clips, which doesn’t track with the claims at all.
The Doom community has had random level generators for over a decade without any modern AI garbage involved.
Stephanie Sterling of the Jimquisition outlines the thinking involved here. Well, she swears at everyone involved for twenty minutes. So, Steph.
She seems to think the AI generates .WAD files.
I guess they fell victim to one of the classic blunders: never assume that it can’t be that stupid, and someone must be explaining it wrong.
twitter comment:
they made something that actually does not run doom, which is a first at least