There is no theory why the gap shouldn't be closed. At the same time, people are...

matusp 39 days ago | parent | context | favorite | on: DiffusionGemma Technical Report

There is no theory why the gap shouldn't be closed. At the same time, people are trying to make them work for years by now and it's never good enough. But they are competing with incredibly optimized architectures.