This functionality is currently under review and may be removed in a future version of WebCopy. If you currently use this feature, we would be grateful if you could email docs@cyotek.com and explain your use case for the feature.
If the site to be copied has links to domains that you wish to automatically convert to the domain being crawled, you can use the Domain Aliases function.
If your expression includes any of the
^
,[
,.
,$
,{
,*
,(
,\
,+
,)
,|
,?
,<
,>
characters and you want them to processed as plain text, you need to "escape" the character by preceding it with a backslash. For example, if your expression wasapplication/epub+zip
this would need to be written asapplication/epub\+zip
otherwise the+
character would have a special meaning and no matches would be made. Similarly, if the expression wasexample.com
, this should be written asexample\.com
, as.
means "any character" which could lead to unexpected matches.