deepbot

Deepbot is a crawling with deep indexing by search engines.

If the robots and crawlers of the search engines only capture and index new and updated web pages, we speak of freshbots. If, on the other hand, they independently capture all the subpages of a website, this is known as deepbots or deep crawl.

Deepbot capture web pages at all levels of the directory It is a process that not all search engines support. Those that do not support Deepbot only capture logged-in web pages and web pages up to a certain directory depth.