Can we have more things like this, please? This is an AMAZING introduction to these concepts.
I wish more people on Hacker News would make such clear blog posts for their personal share of cryptic knowledge, helping other people through the door.
I also want that, the side-by-side comparison specially. The follow up discussions are also helpful, someone mentioned about C5.0 I didn't know about. There are lot of algorithms/steps pieces that are needed when solving the machine learning puzzle. The article was very helpful.
What I was really hoping for was a layman's translation of the maths on wikipedia [ie. how to implement]. But this is a good jumping off point for figuring out which black box to use.
I'm just saying it takes about 30 seconds to explain the Metropolis-Hastings algorithm in plain english, and the wikipedia article is almost intentionally esoteric on the matter:
I'll add my noise to the cacophony and agree that this is a grat article. I've been struggling with an idea for a while, and this has opened up a whole new horizon of possibility for me. So thanks.
Wow, this is an awesome read. I especially like how each algorithm starts with a simple explanation and then dives deeper into each lesser known vocabulary.
I'd be interested in just about every algorithm explained this way! And as a side note some of these algorithms certainly are used in computer vision, k-means for example in clustering/segmentation.
In kernel density estimation, each observed data point is spread out by a "kernel" function such as a Gaussian, essentially exp(-0.5*x^2), or uniform function, f(x) = 1 for |x| < 0.5. So I think of a "kernel" as a function used to distribute a point mass.
I wish more people on Hacker News would make such clear blog posts for their personal share of cryptic knowledge, helping other people through the door.