On: Beyond Diffusion: Inductive Moment Matching

[lukasb]

Yeah I guess progressive refinement is limited in quality by how good the first N iterations are that establish the broad outlines.

[vessenes → lukasb]

FWIW i don’t think we’ve seen nearly all the ideas for text diffusion yet — why not ‘jiggle the text around a bit’ when things have stabilized, or add space to fill, or have a separate judging module identify space that needs more tokens? Lots of super interesting possibilities.