Hacker News new | past | comments | ask | show | jobs | submit login
Hopular: Modern Hopfield Networks for Tabular Data (paperswithcode.com)
37 points by rntn on June 6, 2022 | hide | past | favorite | 9 comments




One day these researchers will learn to give Bojan Tunguz a quick first pass before claiming their new model is the latest tabular data wonder tool.


That "notable criticism" is terrible. His whole argument is that because this algorithm does not outperform sklearn's HistGradientBoostingClassifier the paper is useless and a waste of his "very precious time"


The tweets / medium article are a bit incomplete. But they mean at least: - Authors didn't make decent efforts to build a robust baseline. Worse it seems that they have purposefully built a bad baseline to make their solution look better. - Authors didn't really disclose full performance. Statistical performance is one thing but time complexity is another. Hopular needs 10 mins on a 500 rows datasets. That's a NO NO for any serious application. - Authors didn't provide an easy to use interface. You can't really claim SoTA on small tabular data with something that isn't testable by everyone.


I think it is notable because he's an expert in that area and would know how to assess it. I'm not a fan of the tone either though...

But the authors claim "Hopular surpasses Gradient Boosting (e.g. XGBoost), Random Forests, and SVMs on tabular data." So if a simple sklearn model works better, it's worth knowing it might not be all it's cracked up to be before deciding to spend hours understanding another paper.


https://twitter.com/tunguz/status/1532480966836510753

The fact that SVM was the #2 algo in these results, and that linear methods beat out all the other methods means there's something going awry.


Also more context about criticism from the paper's authors here: https://twitter.com/bschaefl/status/1532281938593173504


Tunguz appears to have not acknowledge or replied or even linked the authors' response in his post or tweets, despite several days now. Bad form.


Thank you for the link!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: