Crawling above the root URL

If set the crawl address for a project to be a nested URL such as https://demo.cyotek.com/features, by default WebCopy will not crawl above this URL. For example, it would process /features/cdn.php, but would skip /html/elements/base.php. In some circumstances it may be desirable to allow this without changing the root URL to be at a higher level.

To enable or disable crawling above the root URL

1. From the Project Properties dialogue, select the Advanced category
2. Check or uncheck the Crawl above the root URL option