Many web servers can compress data prior to sending it, using a variety of different compression methods. When a client makes a request of a server, it includes the
Accept-Encoding header which informs the server which encoding methods the client supports. WebCopy supports the following compression methods
Disabling compression will mean the Accept-Encoding header will not be sent with requests, informing the web server not to compress content before serving it.
To enable or disable compression
- From the Project Properties dialog, select the HTTP Compression option group.
- Check or uncheck the types of compression methods you wish to support.
Some servers may not support all available compression options. If you receive 406 (Not Accepted) errors when trying to copy a website, specifying an unsupported encoding could be the cause.
- Customizing Projects
- Specifying the web site
- Specifying the save folder
- Remapping extensions
- Specifying how a website is crawled
- Specifying default documents
- Crawling additional root URL's
- Updating local time stamps
- Scanning custom attributes
- Fixing sites using mixed prefixes
- Extracting inline data
Advanced Project Customization
- Advanced Project Customization
- Configuring the behaviour of link maps
- Configuring domain aliases
- Specifying a User Agent
- Disabling header checking
- Following redirects
- Crawling above the root URL
- Using a proxy server
- Crawling additional hosts
- Transforming URI's
- Configuring security protocols
- Defining custom headers