By default, WebCopy will send a HEAD command to all URL's to check their content types before downloading the content via a GET. You can disable this behavior and always GET if required, however this is not recommended unless not supported by the website you are trying to crawl.

To enable or disable header checking

  1. From the Project Properties dialog, click the Advanced category
  2. Check or uncheck the Use header checking option

If header checking is disabled, the full contents of any non-excluded file will always be downloaded regardless of it's content type. Where possible, header checking should be left enabled.

© 2010-2018 Cyotek Ltd. All Rights Reserved.
Documentation version 1.5 (buildref #501.-), last modified 2018-05-20. Generated 2023-04-02 08:08 using Cyotek HelpWrite Professional version 6.19.1