Cyotek Sitemap Creator HelpWeb pages are sometimes offered in more than one language. Sitemap Creator allows you to configure a list of languages to send to a web server, and if it supports multiple languages it will try and match against the list.
Sitemap Creator allows the language to be set at both an application level and at the project level. If project settings are not defined, the application settings will be used. If application settings are not defined then the OS language will be used.
Updating the web page language preference
- From the Project Properties dialogue, select the Web Page Language category
- Select a language from the list and click the Add button
See Also
Configuring the Crawler
Working with local files
- Extracting inline data
- Remapping extensions
- Remapping local files
- Updating local time stamps
- Using query string parameters in local filenames
Controlling the crawl
- Content types
- Crawling above the root URL
- Crawling additional root URLs
- Including additional domains
- Including sub and sibling domains
- Limiting downloads by file count
- Limiting downloads by size
- Limiting scans by depth
- Limiting scans by distance
- Scanning data attributes
- Setting speed limits
- Working with Rules
JavaScript
Security
- Crawling private areas
- Manually logging into a website
- TLS/SSL certificate options
- Working with Forms
- Working with Passwords
Modifying URLs
Advanced
- Aborting the crawl using HTTP status codes
- Cookies
- Defining custom headers
- Following redirects
- HEAD vs GET for preliminary requests
- HTTP Compression
- Modifying page titles
- Origin reports
- Overwriting read only files
- Saving link data in a Crawler Project
- Specifying a User Agent
- Specifying accepted content types
- Using Keep-Alive