On: The Era of 1-bit LLMs: ternary parameters for cost...

[HPsquared]

With enough parameters, it probably starts looking continuous again. Like how in physics everything is quantised at the smallest scale but if you put enough atoms together it all smooths out and behaves "classically".

[amelius → HPsquared]

Yes, but we can simulate classical physics using mathematical shortcuts. Simulating every little atom would take a lot more work.