ITWissen.info - Tech know how online

deepbot

Deepbot is deep indexing by search engines.

If the robots and crawlers of the search engines only capture and index new and updated web pages, we speak of freshbots. If, on the other hand, they independently capture all sub-pages of a website, then we are talking about deepbots or deep crawl.

Deepbot capture web pages at all levels of the directory It is a process that not all search engines support. Those that do not support deepbot only capture submitted web pages and web pages up to a certain directory depth.

Informationen zum Artikel
Englisch: deepbot
Updated at: 07.03.2018
#Words: 168
Links:
Translations: DE