Search engine crawl system
Search Engines: Google, Bing and their competitors
Quizzed article REF: H7240 V3
Search engine crawl system
Search Engines: Google, Bing and their competitors

Author : Olivier ANDRIEU

Publication date: April 10, 2022, Review date: February 29, 2024 | Lire en français

Logo Techniques de l'Ingenieur You do not have access to this resource.
Request your free trial access! Free trial

Already subscribed?

2. Search engine crawl system

As we have already seen, several steps are necessary for a search engine to function properly:

  • In the first phase, software crawls the Web from link to link, retrieving information from web pages;

  • This information is then indexed by indexing engines, with the indexed terms enriching a regularly updated – database of words contained in – pages;

  • finally, a search interface enables results to be returned to users by ranking them in order of relevance.

2.1 Spiders / Robots

Spiders (also known as agents, crawlers, robots or bots) are browser programs that constantly visit web pages and links to index...

You do not have access to this resource.
Logo Techniques de l'Ingenieur

Exclusive to subscribers. 97% yet to be discovered!

You do not have access to this resource. Click here to request your free trial access!

Already subscribed?


Article included in this offer

"Digital documents and content management"

( 71 articles )

Complete knowledge base

Updated and enriched with articles validated by our scientific committees

Services

A set of exclusive tools to complement the resources

View offer details