Some sites may contain mix of prefixed and non-prefixed URLs. For example, domain http://www.example.com may have links to both http://www.example.com and http://example.com. If configured correctly, the non-WWW links should redirect to the WWW links (or vice-versa), but if not, or if you want to copy a site without the interim redirects, Sitemap Creator can help.

To automatically fix mixed prefixes

  1. From the Project Properties dialogue, select the URL Normalization category
  2. Check the Ensure internal links match domain prefix option

When this option is set, Sitemap Creator will automatically transform any links that match the source host, but either have a WWW prefix and the source does not, or do not have a WWW prefix while the source does.

Note that this option only applies to URLs matching the host domain; it will not apply to any external domains included in the copy.

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Advanced

Deprecated features

© 2010-2023 Cyotek Ltd. All Rights Reserved.
Documentation version 1.2 (buildref #81.15583), last modified 2023-04-09. Generated 2023-04-29 14:30 using Cyotek HelpWrite Professional version 6.19.1