On: Apple's On-Device and Server Foundation Models

[astrange]

The "bitter lesson of machine learning" means that you actually can't do anything novel; it won't work as well as just doing the simple thing but bigger.

(So there is room left if you're limited by memory or budget.)