Each time Microsoft Office SharePoint Portal Server 2003 updates a content index, it creates a gatherer log file. This file contains data about URLs that SharePoint Portal Server accesses while creating an index. The file can record successful accesses, access errors, and accesses disallowed by rules (in case the user needs to debug the index restrictions).
You can filter this log file and view the gatherer log for a specific content source.
By default, SharePoint Portal Server does not log successful accesses and accesses disallowed by rules. SharePoint Portal Server deletes the log after five days.
Note By default, the gatherer log shows only the information from the last crawl. If you want to see results from previous crawls, you must clear the Restrict retrieval to last crawl check box. If a crawl has just started, you might not see any results for several minutes.