Many web servers can compress data prior to sending it, using a variety of different compression methods. When a client makes a request of a server, it includes the Accept-Encoding header which informs the server which encoding methods the client supports. Sitemap Creator supports the following compression methods

  • Deflate
  • GZip
  • Brotli
  • Identity (no compression)


Disabling compression will mean the Accept-Encoding header will not be sent with requests, informing the web server not to compress content before serving it.

To enable or disable compression

  1. From the Project Properties dialogue, select the HTTP Compression option group.
  2. Check or uncheck the types of compression methods you wish to support.


Some servers may not support all available compression options. If you receive 406 (Not Accepted) errors when trying to copy a website, specifying an unsupported encoding could be the cause.

See Also

Configuring the Crawler

Working with local files

Controlling the crawl



Modifying URLs


Deprecated features