Some sites may contain mix of prefixed and non-prefixed URLs. For example, domain http://www.example.com may have links to both http://www.example.com and http://example.com. If configured correctly, the non-WWW links should redirect to the WWW links (or vice-versa), but if not, or if you want to copy a site without the interim redirects, WebCopy can help.

To automatically fix mixed prefixes

  1. From the Project Properties dialogue, select the URL Normalization category
  2. Check the Ensure internal links match domain prefix option

When this option is set, WebCopy will automatically transform any links that match the source host, but either have a WWW prefix and the source does not, or do not have a WWW prefix while the source does.

Note that this option only applies to URLs matching the host domain; it will not apply to any external domains included in the copy.

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Creating a site map

Advanced

Deprecated features

© 2010-2024 Cyotek Ltd. All Rights Reserved.
Documentation version 1.10 (buildref #186.15944), last modified 2024-08-18. Generated 2024-08-18 08:00 using Cyotek HelpWrite Professional version 6.20.0