If set the crawl address for a project to be a nested URL such as https://demo.cyotek.com/features, by default WebCopy will not crawl above this URL. For example, it would process /features/cdn.php, but would skip /html/elements/base.php. In some circumstances it may be desirable to allow this without changing the root URL to be at a higher level.

To enable or disable crawling above the root URL

  1. From the Project Properties dialog, select the Advanced category
  2. Check or uncheck the Crawl above the root URL option

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Creating a site map

Advanced

Deprecated features