Indexing Crawler

What is an Indexing Crawler?

An indexing crawler - also known as a search engine bot or spider - is an internet bot used by search engines to visit websites and discover or read their web pages in order to add them to their index. I.e. Google's indexing crawler is known as Googlebot.

If you want to learn more about Google Bot, read here.

Related Articles