On: Nepenthes is a tarpit to catch AI web crawlers

[gruez]

Off the top of my head: https://everyuuid.com/

https://github.com/nolenroyalty/every-uuid

[johnisgood → gruez]

How is that infinite if the last one is always the same? Am I misunderstanding this? I assumed it is almost like an infinite scroll or something.

[gruez → johnisgood]

Here's another site that does something similar (iterating over bitcoin private keys rather than uuids), but has separate pages and would theoretically catch a crawler:

https://allprivatekeys.com/all-bitcoin-private-keys-list

[johnisgood → gruez]

503 :D

[diggan → gruez]

Aren't those finite lists? How is a scraper (normal or LLM) supposed to "get stuck" on those?

[gruez → diggan]

even though 2^128 uuids is technically "finite", for all intents and purposes is infinite to a scraper.