Deep learning is changing the field of AI and I expect that with a few more breakthroughs in training algorithms and hardware everything will start to change, hopefully for the better. I wonder when we will see ultra low power neural chips in cellphones.
In the 1980s, my team at SAIC built special purpose neural hardware: Harvard memory architecture designed to run backprop quickly. We got 5 megaflops out of our boards and we were happy enough.
I'd be interested to hear from somebody who knows more.
If you call it software you can.
I wonder if the death of Moore's Law finally opens the way for entrants.