Disabling header checking

By default, WebCopy will send a HEAD command to all URL's to check their content types before downloading the content via a GET. You can disable this behavior and always GET if required, however this is not recommended unless not supported by the website you are trying to crawl.

To enable or disable header checking

1. From the Project Properties dialog, click the Advanced category
2. Check or uncheck the Use header checking option

If header checking is disabled, the full contents of any non-excluded file will always be downloaded regardless of it's content type. Where possible, header checking should be left enabled.