Hacker News new | comments | show | ask | jobs | submit login
Neural Network on a Commodore 64 (1987) (fourmilab.ch)
112 points by ingve 11 months ago | hide | past | web | favorite | 21 comments

It's pretty neat that if you run Attneave's Cat through Google Images[0] its best guess is that it's an image of a cat.

[0] https://www.google.com/search?tbs=sbi:AMhZZis-EoFUya0lMH5oOq...

That might partially be because it's already indexed the original page, and noticed that its caption includes "Cat".

If you think that's cool, you might also be interested to know that Marvin Minsky programmed a neural network all the way back in 1951: https://en.m.wikipedia.org/wiki/Stochastic_neural_analog_rei...

Anybody know when the term "Neural Net" first appeared?

Just read Heinlein's "The Moon is a Harsh Mistress", published in '66, and there are a couple of mentions of "neural nets".

McColloch and Pitts and are generally credited with the theoretical foundations of artificial neurons in the 40s, and around that time Hebb was doing some pioneering work on activation potentials, but traces of the idea can be found as far back as James's Principles of Psychology.

Thanks, but I mean specifically the term "neural net". Saw some older papers mention artificial neutrons but interested when they used the term 'net'

The primary paper by McColloch and Pitts is "A Logical Calculus of Ideas Immanent in Nervous Activity" (1943) it doesn't use exactly the term "neural net" but it mentions nets, networks, and "nervous nets". But it seems like the term "nervous net" goes back to the 19th century as a description of primitive neural arrangements in biology.

Very cool!

I remember adapting backpropagation network code from German C't magazine to HiSoft Pascal on ZX Spectrum. Only a few bits worth of inputs, but watching it run and converge was fascinating.

The 80s saw the creation of the neocognitron, self organized maps and the first recurrent neural networks (e.g: hopfield networks, boltzmann machines).

It also saw the first application of backpropagation to neural networks.

Had this actually been published in a Commodore magazine it would have changed my life - revealed a whole new area of computer science to the teenaged me, fifteen years before I actually encountered it. Damn.

Which means that quite possibly papers are coming out this very second with concepts you will treasure years in the future unless you take quick action. You need to start reading the professional literature more, Glen!

People did some pretty cool things with the C64. Back when I was in college (88-91), two professors in the Math department built an interface that hooked up 4 C64 computers so they could run parallel stuff. I guess it was the cheapest solution to the problem.

Thats weird, you could get a (Atari 1040 STFM) 1M 8Mhz 68000 at that time for less than those 4 C64:s

Maybe the point was to explore methods of parallelism?

Perhaps they already had them on hand? I have 2 C64 machines still!

You and matt_the_bass are right. They had 4 on hand and wanted to explore parallelism. I think they tried to buy some transputer boards first without success then figured they could afford the parts to build the interface. I’m told it was pretty fun to program.

> If you walk up to a computer and ask it “what is the name of the famous bridge in the same state as Disneyland” you won't have much success, but most people will immediately answer, “The Golden Gate Bridge”.

30 years later: https://www.google.com/search?q=what+is+the+name+of+the+famo...

Look at the first result.

The golden gate bridge is the third result here, with the same link. Seems like you can't rely on google search results to be the same from country to country and person to person.

Yeah, that's definitely true

Change "disneyland" to "empire state building" and it works decently. Change it to "wall street" and it fails. Still, not bad at all.

John Walker is awesome. Founder of Autocad and good guy to the hacker community when he was in the Bay Area.

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact