On: Show HN: Voyager – write a web crawler/scraper as a state machine in Rust

[ashish01]

You can limit the numbers pf concurrent calls using a semaphore and acquiring it before making a http request.