On: Pen and Paper Exercises in Machine Learning (2022)

[incognito124]

Maybe this will help:

https://github.com/google-research/tuning_playbook

[danielscrubs → incognito124]

”Summary: When starting a new project, try to reuse a model that already works.”

”Summary: Start with the most popular optimizer for the type of problem at hand.”

This is like when game designers say: try a bunch of different stuff!

Aka. we have no idea, but we have the manpower to throw things at the wall for years. May the richest, not most clever, company win!

[lucasoshiro → incognito124]

Thanks!