Chilkat Spider ActiveX download

Components are used to scan a spider web site.

"Spider-Component is used to scan a web site."
indir.biz Editor: Spider Component Properties
-Crawl a web site.
Outbound links to other web sites-Accumulate for scanning.
-Cache pages can be sold so that future scans the cache.
Robots.txt compliant. each page
-Fetch HTML content crawled.
-Able to scan HTTPS pages.
Define "s to prevent to prevent certain wildcard pattern matching patterns.
Define "outbound links that match the pattern to avoid avoid.
-read and connect timeout.
URLs to avoid ever-maximum URL size is growing.
-Maximum size is too big or respond to pages with content to prevent infinite.
-Wind-down pages to set a limit per site spidered counts. Now you can download free Chilkat Spider ActiveX 2.2.2.