I recently listened to this talk https://www.youtube.com/watch?v=Jnunp-EymJQ&=&feature=youtu.be
and I've been thinking a lot about large scale, modular neural networks recently and their applicability in many real world settings.
Other than Google, and maybe other FAANG Cos to a lesser extent, it seems like no company is really leveraging massive distributed systems and massive modular, mixture of expert models.
Isn't there a huge opportunity to help Fortune 500 Cos build these systems out?
