Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Sampling in hip hop is about taking 1 or 2 audio sources mapping them into some new audio, SD was trained on 2.3 billion data points. In a diffusion model you put noise on an input image, until its recognizeable. For a song this would mean, making it unrecognizable by making it literally sound like noise, and then try to denoise it, this process wouldn't be very helpful i assume, but might be a good experiment. Open AI's Jukebox uses an autoenconder method with autoregressive transformers, given this architecture, i would assume you can theoretically do stable diffusion architecture on audio, to generate new audio. https://openai.com/blog/jukebox/


The processes are essentially identical while the specifics and quantities differ.

- acquire samples

- process until output is "recognizable"

- manipulate until output is desirable

Stable Diffusion requires IP as an input.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: