Episode 2 of 9 · Google Search
The crawler: fetching is the easy ten percent
Included with a plan
This video is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.
Chapters
The crawler: fetching is the easy ten percent. A crawler is a loop around a queue that never empties. Every page you fetch hands you its outlinks, and those go straight back into the queue. So the web crawls itself, forever, an
Based on the board The Crawler.
Covered in Google Search - the case study.
Saved in this browser only.