On: How to Write Fast Code

To first order, the number of instructions executed is not at the top of the list of things that make programs slow.

IO is. And, if you're not IO bound, you're probably memory bound.

Yes, caches help a lot, but a memory cache miss is 1-400 cycles and IO is far more expensive. In other words, cosine is faster than a cache miss.