Hacker News new | past | comments | ask | show | jobs | submit login
Pass: An ImageNet replacement for self-supervised pretraining without humans (ox.ac.uk)
57 points by hexfaker on Sept 29, 2021 | hide | past | favorite | 11 comments



I wonder if that's a good idea.

One could easily argue that throughout all of human evolution, recognizing and interacting with other humans was the single most important factor for survival. Accordingly, one would expect the human visual system to be highly adapted towards recognizing humans. [1]

If we want AI to safely interact with humans, then we should strive to make the AI understandable in the sense that our intuition of what it might see or do matches up with what it'll actually see or do. That's a big aspect why those Tesla crashes are so scary: No human would overlook a huge white truck sideways on the road. But an AI trained on the wrong dataset might.

Accordingly, I would have expected that datasets move more towards imitating what babies will see in their first days or weeks, because that seems to be the most promising path towards replicating human vision with AI.

[1] https://news.stanford.edu/news/2012/december/infants-process...


They do say the dataset is for pretraining. If your application needs the ability to identify humans, then your fine-tuning dataset would include humans.

This seems totally appropriate for pretraining on natural images IMO.


Wouldn't your pretrained model be lacking in neurons that react to human features though? Seems like a poor choice if your ultimate goal is human images.


The car industry's argument against this would be: who cares if the car makes a mistake a human whould never make if the overall statistics of (fatal) accidents go down?


Also my argument.


What if you are a better-than-average driver?


Every car accident (2) I've ever been in involved someone else making a mistake, so my driving skill isn't particularly relevant.


Maybe that's because you drive better than average, and you should be worried about FSD vehicles.


That doesn't make any sense.

If an FSD vehicle is better at driving than the average driver, then I am safer, regardless of my driving ability, because it means other cars are less likely to crash into me.

If I am above average driver, I can make the choice to continue driving instead of letting FSD take the wheel, but I probably won't.


I wonder how much worse the performance will be on human-related downstream tasks.


This is amazing, so much value for the researchers




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: