I know it sounds like fiction, but that's what's happening on the Web right now . The books are the individual sites, the chapters are the respective web pages, and the endless document is the index you access every time you perform a search on any search engine. As of November 2016, the number of individual pages registered in Google's index exceeded 130 trillion. Not bad for little spiders!
Now, what is Googlebot?
Googlebot is the name given to these “robot spiders.” Every whatsapp philippines number search engine has its own robots, so Googlebots are unique to Google. The job of these diligent spiders is to crawl through updates to existing pages and find new pages to rank and enter into the index.
Having our pages and updates registered in this index is the first step in building our visibility and positioning on the Web.
Basic concepts to understand it
Crawling
In English, the word “crawl” refers to the slow movement with which certain insects move. In our context, crawling is the process carried out by search engines to identify and classify web pages. Thus, “crawler” is another way of referring to robots (which is quite ironic, since these spiders are not slow at all).
Crawling is done periodically to identify updated content, obsolete links, etc.
Index
“Index” means “index” in English. Every time a Googlebot visits a web page, it indexes it, that is, it includes it in the index. And every time you perform a search, the search engine goes to the part of the index where this page is located and assigns it a position, which depends on an algorithm.
Algorithm
Performing a search is like asking a search engine something. You don't need millions of answers, you just need one or a few that give you the right information. That's what algorithms are for, which determine the positioning of a page with respect to a specific search.
The more than 200 factors that the algorithm takes into account to make this decision are secret. However, there are SEO techniques that help improve organic positioning in search engines.