The General settings category allows you to configure the website to crawl and how it should be crawled.

See Also

Configuring the Crawler

Working with local files

Controlling the crawl

JavaScript

Security

Modifying URLs

Creating a site map

Advanced

Deprecated features

© 2010-2021 Cyotek Ltd. All Rights Reserved.
Documentation version 1.8 (buildref #768.-), last modified 2021-03-30. Generated 2023-04-02 08:02 using Cyotek HelpWrite Professional version 6.19.1