This is why GenAI exists. GenAI took the good people, the money, the resources and the scope. Zuck tolerates entertains ideas until he doesn’t. It’s clear blue sky research is going to be pushed even further into the background
I agree with most this, I just think we have different meanings of failure. FAIR has "failed" in the eyes of Meta leadership in that they have not converted into a "frontier AI lab" like Deepmind, and as a result they are being sidelined (much like Google Research, which I admit was a bad example). But the orgs were founded to pursue basic research and I think it's not the a failure of the scientists at FAIR that management has failed to properly spin out GenAI. Of course, it sounds like your metric is "AI/LLM competitiveness" and we have no disagreements that FAIR is failing on that end (I just don't think its only important or right metric to be judging FAIR).
* Normatively, I think that it's good to have monopolistic big tech firms be funding basic open research as a counterbalance to academia and also because good basic research requires lots of compute these days. It feels somewhat shortsighted to reallocate all resources to LLM research.
* DINO and JEPA aren't particularly useful for language modeling, but are still important for embodiment/robotics/3D, which indeed seems to be the "next big thing." Also, to their credit, FAIR is still doing interesting and useful work on LLMs for encoders [1], training dynamics [2], and multimodality [3], just not training frontier models.
** GenAI took the money, scope, and resources, but not sure about the good people lol, that seems to be their problem.
I agree with most this, I just think we have different meanings of failure. FAIR has "failed" in the eyes of Meta leadership in that they have not converted into a "frontier AI lab" like Deepmind, and as a result they are being sidelined (much like Google Research, which I admit was a bad example). But the orgs were founded to pursue basic research and I think it's not the a failure of the scientists at FAIR that management has failed to properly spin out GenAI. Of course, it sounds like your metric is "AI/LLM competitiveness" and we have no disagreements that FAIR is failing on that end (I just don't think its only important or right metric to be judging FAIR).
* Normatively, I think that it's good to have monopolistic big tech firms be funding basic open research as a counterbalance to academia and also because good basic research requires lots of compute these days. It feels somewhat shortsighted to reallocate all resources to LLM research.
* DINO and JEPA aren't particularly useful for language modeling, but are still important for embodiment/robotics/3D, which indeed seems to be the "next big thing." Also, to their credit, FAIR is still doing interesting and useful work on LLMs for encoders [1], training dynamics [2], and multimodality [3], just not training frontier models.
** GenAI took the money, scope, and resources, but not sure about the good people lol, that seems to be their problem.
[1] https://arxiv.org/abs/2504.01017 [2] https://arxiv.org/abs/2505.24832 [3] https://arxiv.org/abs/2412.14164