Hacker News new | past | comments | ask | show | jobs | submit login
Forward-Forward Algorithm, an Alternative to Backpropagation for Neural Networks (syncedreview.com)
40 points by kumarvvr 3 months ago | hide | past | favorite | 5 comments




I've seen this going around my circle and found it very interesting. What I don't have though is a very useful basis for comparison. I'm curious if anyone here knows of any previous attempts at alternatives to back propagation? I think it'd be useful to me to understand better why backprop has withstood the test of time.



So the best part of backwards prop is that you need very little memory to complete the training which matters on GBs of data. FF seems to allow for more parallel computing but you will need to keep at least one more set of coefficients more in storage to deal with scheduling conflicts? Definitely merits more work.


How is this different from "skip-forwarding" of ResNets?




Applications are open for YC Summer 2023

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: