Google says 3e-4 is the best lr for Adam (misinterpreted Karpathy's joke) | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

		Google says 3e-4 is the best lr for Adam (misinterpreted Karpathy's joke) (google.com)
		1 point by vukadinovic on Jan 27, 2022 \| hide \| past \| favorite \| 1 comment

vukadinovic on Jan 27, 2022 [–]

Google misinterpreted Karpathy's (joke) tweet, and by searching " what is the best learning rate for adam optimizer " says that " 3e-4 is the best hands down ".

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact