Uses of Class
org.archive.crawler.datamodel.RobotsHonoringPolicy

Packages that use RobotsHonoringPolicy

org.archive.crawler.datamodel

Uses of RobotsHonoringPolicy in org.archive.crawler.datamodel

Fields in org.archive.crawler.datamodel declared as RobotsHonoringPolicy

(package private) RobotsHonoringPolicy

RobotsExclusionPolicy.honoringPolicy

Methods in org.archive.crawler.datamodel that return RobotsHonoringPolicy

RobotsHonoringPolicy

CrawlOrder.getRobotsHonoringPolicy() This method gets the RobotsHonoringPolicy object from the orders file.

Methods in org.archive.crawler.datamodel with parameters of type RobotsHonoringPolicy

static RobotsExclusionPolicy

RobotsExclusionPolicy.policyFor(CrawlerSettings settings, java.io.BufferedReader reader, RobotsHonoringPolicy honoringPolicy)

Constructors in org.archive.crawler.datamodel with parameters of type RobotsHonoringPolicy

RobotsExclusionPolicy(CrawlerSettings settings, Robotstxt robotstxt, RobotsHonoringPolicy honoringPolicy)