You can find the full article (with more context) now on Medium
When programming a web-scraper, let your code sleep. A lot.
Think about where you need to sleep (e.g., in everyiteration of a for-loop). Consider randomly selecting the exact sleep time for every iteration, as this is closer to a human interaction than waiting exactly 5 seconds every time.