Hacker News new | past | comments | ask | show | jobs | submit login

I was really hoping this was a "diffusion model" in the same sense that these guys built a reaction-diffusion based self-healing system:

https://distill.pub/2020/growing-ca




Yeah, the neural network "diffusion models" are not very well named. If you have background in natural sciences, you would understand diffusion to mean, well, diffusion. Whereas there generative neural networks are about (1) blurring data by Gaussian noise, (2) teaching a NN to denoise the noised data, and finally (3) with Gaussian noise as input, let the denoiser NN to generate new data. So it's not so much about diffusion as it's about reversing the diffusion. And it's not really (smooth) diffusion, but Gaussian noise.

"Denoising autoencoder" is already used for processes that reconstruct partially corrupted input. So what name to suggest for a process that reconstructs data from nothing but noise?


The reaction diffusion / NCA models have been applied to videos recently — check it out:

https://wandb.ai/johnowhitaker/nca/reports/Fun-with-Neural-C...


That was a fascinating article with a great mix of readability and interactive demos.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: