Hacker News new | past | comments | ask | show | jobs | submit login

As a data engineer who needs to crawl websites sometimes, Mixnode looks interesting to me. I agree that it is hard to make scraping a product because it is so use case specific. However crawling, defined as downloading all HTML, PDF, images on a given site, is a pretty common first step and something that could be a product. Then turning that into SQL sounds pretty awesome.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: