Hacker News new | past | comments | ask | show | jobs | submit login
Show HN: Linkgrabs.com the Simple and Fast API to Fetch JavaScript Web Pages (linkgrabs.com)
7 points by macinjosh 7 months ago | hide | past | favorite | 2 comments
For some of my work with LLMs and RAG I needed to be able to fetch content from my customer's support site. Basic cURL calls weren't working because the site is an SPA and is rendered completely through javascript.

The trouble it took me to figure out how to capture the rendered HTML from a headless browser and how to do it reliably in production inspired me to create LinkGrabs.com so others would not have to go through the same pain.




Do you have any plans of open sourcing this?

Because I was thinking of making the same exact thing but in https://bun.sh/ for a use case I had for only taking screenshots at cron jobs.

I really like this tool but I would really love it if you could open source it and the website seems very premature (like the astro logo)

Other than that good job. I would like to see how this project progresses.


I can't seem to understand how to use curl / post requests to get png from a website? Your curl example only responds with html




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: