Important

This functionality is currently under review and may be removed in a future version of WebCopy. If you currently use this feature, we would be grateful if you could email docs@cyotek.com and explain your use case for the feature.

If the site to be copied has links to domains that you wish to automatically convert to the domain being crawled, you can use the Domain Aliases function.

To customise domain aliases

  • From the Project Properties dialogue, select the Domain Aliases category

Adding a new alias

  1. Click the Add button
  2. In the Expression field, enter the name of the domain that will be aliased. This field supports regular expressions

Important

If your expression includes any of the ^, [, ., $, {, *, (, \, +, ), |, ?, <, > characters and you want them to processed as plain text, you need to "escape" the character by preceding it with a backslash. For example, if your expression was application/epub+zip this would need to be written as application/epub\+zip otherwise the + character would have a special meaning and no matches would be made. Similarly, if the expression was example.com, this should be written as example\.com, as . means "any character" which could lead to unexpected matches.

Deleting an alias

  1. Select one or more of the aliases you wish to remove from the list
  2. Click the Delete button

Updating an alias

  1. Select the alias you wish to edit from the list. The Expression field will be updated to match the selection
  2. Enter new value for the alias pattern.

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Creating a site map

Advanced

Deprecated features

© 2010-2024 Cyotek Ltd. All Rights Reserved.
Documentation version 1.10 (buildref #185.15779), last modified 2024-03-31. Generated 2024-03-31 14:04 using Cyotek HelpWrite Professional version 6.19.1