When Sitemap Creator downloads a remote file, it uses the path portion of the URL to generate the local file name. However, if a site makes heavy use of query string parameters for URLs you may wish to have the query string parameters incorporated into the generated file names.
Enabling the use of query string parameters for file name generation
- From the Project Properties dialogue, select the Local Files category
- Check the Use query string in local file names option
See Also
Configuring the Crawler
Working with local files
Controlling the crawl
- Content types
- Crawling multiple URLs
- Crawling outside the base URL
- Including additional domains
- Including sub and sibling domains
- Limiting downloads by file count
- Limiting downloads by size
- Limiting scans by depth
- Limiting scans by distance
- Scanning data attributes
- Setting speed limits
- Working with Rules
JavaScript
Security
- Crawling private areas
- Manually logging into a website
- TLS/SSL certificate options
- Working with Forms
- Working with Passwords
Modifying URLs
Advanced
- Aborting the crawl using HTTP status codes
- Cookies
- Defining custom headers
- HEAD vs GET for preliminary requests
- HTTP Compression
- Modifying page titles
- Origin reports
- Overwriting read only files
- Redirects
- Saving link data in a Crawler Project
- Setting the web page language
- Specifying a User Agent
- Specifying accepted content types
- Using Keep-Alive