Some web sites have multiple copies of the same content accessed via different URLs. Often, these sites will indicate the preferred version of the content by including a special tag indicating the canonical URL. Sitemap Creator can optionally honor such preferences, and automatically ignore non-canonical URLs.

To enable or disable canonical URL support:

  1. From the Project Properties dialogue, select the URL Normalization category
  2. Check or uncheck the Honor canonical URLs option

When the option is set, any URL which contain a canonical URL declaration in the page header will be included in the sitemap as normal. If a canonical URL declaration is present however, the URL will be automatically excluded from the site map unless it matches the canonical URL.

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Advanced

Deprecated features

© 2010-2023 Cyotek Ltd. All Rights Reserved.
Documentation version 1.2 (buildref #81.15583), last modified 2023-04-09. Generated 2023-04-29 14:30 using Cyotek HelpWrite Professional version 6.19.1