I wish we were all commenting about the ideas embedded in this paper. It intrigues me, but is out of my comfort zone. Love to read more content-related insights or criticisms rather than the long thread on the shamefully smooth, engaging, and occasionally rote style.
I was reminded immediately of Wolfram’s exploration of using cellular automata to get MNIST recognition results. The underlying mechanisms they both use are super different, but the ideas seem like strong siblings — I attach them in my mind as saying computational complexity is almost shockingly expressive, and finding ways to search around the space of computation is pretty powerful.
That said, I put in like 4 minutes skimming this paper, so my opinion is worth about the average of any Internet forum opinion on this topic.
Anyway, I suggest reading Wolfram as well on this, it’s pretty provocative.
