Often, website URLs are case-sensitive, so meaning two pages named /alpha.html and /Alpha.html are actually different. However, if a website uses case-insensitive URLs, and has a mix of cases pointing to the same pages, this may cause WebCopy to create duplicate versions of content.

To make URL compares case-insensitive

  1. From the Project Properties dialogue, select the URL Normalization category
  2. Check the Ignore case (not recommended) option

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Creating a site map

Advanced

Deprecated features

© 2010-2024 Cyotek Ltd. All Rights Reserved.
Documentation version 1.10 (buildref #185.15779), last modified 2024-03-31. Generated 2024-03-31 14:04 using Cyotek HelpWrite Professional version 6.19.1