- Deep learn everything!
- I took at look at the variable distributions, went with a forest model after transforming some of the data.
That's what a statistician does too... I wish statistician word is more in vogue than data science or machine learners. Statistic is the discipline of data.
I'm going to disagree with you here.
Granted if I tuned both perfectly, CNNs probably would have outperformed but with defaults and a small amount of parameter search, boosting worked best.
Which, BTW, makes them more appealing to me personally. In many real-life cases extra few percent of accuracy matters very little, but ability to just apply something to a problem without much fuss matters a lot.