I think you want both. To scale the model, e.g. train it with more and more data...

menaerus on Feb 15, 2025 | parent | context | favorite | on: Gary Marcus discusses AI's technical problems

I think you want both. To scale the model, e.g. train it with more and more data, you also need to scale your inference step. Otherwise, it just takes too long and it's too costly, no?