freshbot

In crawling, i.e. the indexing of websites by search engine crawlers, there are certain differentiations with regard to indexing.

While deep indexing takes place with the deepbot, in which the crawlers and robots independently capture the subpages of a website, the freshbot or fresh crawl is concerned with the capture of current web pages that have been discontinued or changed at short notice.

With the Freshbot, websites with current content are visited in order to publish them in the results pages as soon as possible. This can also include websites with a low ranking index that occupy upper positions in the results pages. It is a short-term evaluation, which is relativized by the later exact evaluation. The date of acquisition is often displayed during the fresh crawl.