Add a site hit frequency rule to modify demands on specific sites as they are crawled. For more information about site hit frequency rules, see About Site Hit Frequency Rules.
A site name should be in the following form: example.microsoft.com. Do not include http:// in front of the site name.
You can specify rules for individual sites. You can also use wildcard characters in site names to specify rules for multiple sites, as shown in the following table.
| Use | To |
| * as the site name | Apply the rule to all sites. |
| *.* as the site name | Apply the rule to sites with dots in the name. |
| *.site_name.com as the site name | Apply the rule to all sites in the site_name.com domain (for example, *.adventure-works.com). |
| *.top-level_domain_name (such as *.com or *.net) as the site name | Apply the rule to all sites that end with a specific top-level_domain_name (for example, .com, .net). |
| ? | Replace a single character in a rule. For example, *.adventure-works?.com would apply to all sites in the domains adventure-works1.com, adventure-works2.com, etc. |
You can create a frequency rule for *.com that applies to all Internet sites that end in .com. For example, an administrator of a portal might add a content source for samples.microsoft.com. The rule for *.com would apply to this site unless you add a frequency rule specifically for samples.microsoft.com.
In the Number of documents box, type the number of documents to request. The default setting for all sites is five simultaneous document requests.
The minimum number of documents that SharePoint Portal Server can request is one. The maximum number of documents that SharePoint Portal Server can request is 999.
In the Time to wait in seconds box, type the time to wait between document requests.
The minimum time to wait between document requests is one second. The maximum time to wait between document requests is 999 seconds.
If the frequency is too high, SharePoint Portal Server can overload some Web sites with requests. Consider specifying lower frequency rates for Internet sites over which you have no control and higher frequency rates for intranet sites over which you do have control.