Pattern | A regular expression with is matched against a URL while analzying or copying a website. If a match is found, and the rule is enabled, then the attributes below are processed. |
Exclude | Specifies that the URL should be excluded |
Crawl Content | Specifies that although the URL is excluded, its contents should still be scanned |
Include | Specifies that the URL should be included |
Don't Crawl Content | Specifies that although the URL is included, its contents should not be scanned |
Use Full URI | By default, the pattern is only matched on the path and query string of the URL. If this option is specified, the pattern is checked against the entire URL, including domain, schema etc. |
Enable this rule | Specifies if the rule is enabled or not |