Many files on a remote web server may not behave normally when executed from the local file systems, such as .php or .aspx. Sitemap Creator can handle this by changing the extensions of downloaded content to match their mime type. For example, .php and .aspx would be renamed to .html.

By default, Sitemap Creator will only remap HTML files (those with the content type text/html). All other files will use the original extension of the URL.

OptionDescription
NeverNo extension remapping is performed. This option is not recommended
AlwaysSitemap Creator will always try and remap extensions
Only for HTML(Default) Only URLs with a content type of text/html will be remapped
Only if no extension presentURLs without an extension will be remapped, those with an extension will not be modified
Always, except for the specified exclusionsAll URLs except those with a content type of application/octet-stream or with user defined extension or content type exclusions will be remapped

Changing the extension remap mode

  1. From the Project Properties dialogue, select the Local Files category
  2. In the Remap file extensions by content type group, select an appropriate option

Specifying exclusions

  1. From the Project Properties dialogue, select the Local Files category
  2. In the Remap file extensions by content type group, enter exclusions into the Types to exclude field

Tip

Click Select Types to display a dialogue box for selecting content types either from those detected in the site to be copied, or from a global database

Tip

  • You can either enter file extensions, such as png into this field, or content types such as image/png
  • This field supports wildcards

Important

When the mode is Always, except for the specified exclusions, the application/octet-stream exclusion is implicit and cannot be disabled.

Preserving the original extension

When remapping extensions, Sitemap Creator can keep the original extension. For example, if picture.php had a content type of image/png, the local filename would be picture.php.png. To enable or disable this feature

  1. From the Project Properties dialogue, select the Local Files category
  2. In the Remap file extensions by content type group, check or uncheck the Keep original extension field

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Advanced

Deprecated features

© 2010-2023 Cyotek Ltd. All Rights Reserved.
Documentation version 1.2 (buildref #81.15583), last modified 2023-04-09. Generated 2023-04-29 14:30 using Cyotek HelpWrite Professional version 6.19.1