On: From GPT-4 to AGI: Counting the OOMs

[neom]

You're right, I tested it extensively before we designed a training program, it works very well up to about 10/11 but past that it gets lost in the sauce. So pardon me: It only works out to a 6.45 hour savings not a 6 hour savings.