This functionality is currently under review and may be removed in a future version of WebCopy. If you currently use this feature, we would be grateful if you could email docs@cyotek.com and explain your use case for the feature.
If the site to be copied has links to domains that you wish to automatically convert to the domain being crawled, you can use the Domain Aliases function.
If your expression includes any of the ^
, [
, .
, $
, {
, *
, (
, \
, +
, )
, |
, ?
, <
, >
characters and you want them to processed as plain text, you need to "escape" the character by preceding it with a backslash. For example, if your expression was application/epub+zip
this would need to be written as application/epub\+zip
otherwise the +
character would have a special meaning and no matches would be made. Similarly, if the expression was example.com
, this should be written as example\.com
, as .
means "any character" which could lead to unexpected matches.