What Is Mixture-of-Experts (Moe)

[alyona0l]

https://www.turingpost.com/p/moe

[smarm52]

Similar to how thought is organized, as a collection of items, rather than a singlar that it appears to us to be.

https://en.wikipedia.org/wiki/Thought#Computationalism

And then the "Selector" they talk about is similar in function to the neocortex, which selectively inhibits the activation of the other parts of the brain.

https://en.wikipedia.org/wiki/Neocortex

Interesting that the researchers converged to this approach, while not seeming to cite models of thought explicitly.