Some sites may contain mix of HTTP and HTTPS URLs for the same host. For example, domain www.example.com may have links to both http://www.example.com and https://www.example.com. If configured correctly, the HTTP requests should automatically redirect to the more secure HTTPS protocol, but if not, or if you want to copy a site without the interim redirects, WebCopy can help.

Note

When WebCopy forces a URL from HTTP to HTTPS, it marks the original URL as a redirect in the same way it would if the website automatically supported HTTP to HTTPS redirects. However, it will never make any requests to the original URL.

To automatically force all URLs to be HTTPS

  1. From the Project Properties dialogue, select the URL Normalization category
  2. Select the Always option in the Force HTTPS group

Important

If a site doesn't support HTTPS this will cause copy jobs to fail

To automatically force URLs matching one or more hosts to be HTTPS

  1. From the Project Properties dialogue, select the URL Normalization category
  2. Select the Custom option in the Force HTTPS group
  3. Enter the host names that you wish to force to be HTTPS

To disable forced HTTPS

  1. From the Project Properties dialogue, select the URL Normalization category
  2. Select the Never option in the Force HTTPS group

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Creating a site map

Advanced

Deprecated features

© 2010-2024 Cyotek Ltd. All Rights Reserved.
Documentation version 1.9 (buildref #182.15707), last modified 2024-03-15. Generated 2024-03-15 22:36 using Cyotek HelpWrite Professional version 6.19.1