Basically we had the same infrastructure back in the day at Trulia - a dedicated...

		encoderer on April 18, 2024 \| parent \| context \| favorite \| on: Reddit is taking over Google Basically we had the same infrastructure back in the day at Trulia - a dedicated “bot cluster” We had two charges from management: let google crawl as fast as it possibly can, and don’t let it disrupt users.