|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use IURLFilter | |
---|---|
com.norconex.collector.http.crawler | |
com.norconex.collector.http.filter.impl | |
com.norconex.collector.http.robot |
Uses of IURLFilter in com.norconex.collector.http.crawler |
---|
Methods in com.norconex.collector.http.crawler that return IURLFilter | |
---|---|
IURLFilter[] |
HttpCrawlerConfig.getURLFilters()
|
Methods in com.norconex.collector.http.crawler with parameters of type IURLFilter | |
---|---|
void |
IHttpCrawlerEventListener.documentRobotsTxtRejected(HttpCrawler crawler,
String url,
IURLFilter filter,
RobotsTxt robotsTxt)
|
void |
HttpCrawlerEventAdapter.documentRobotsTxtRejected(HttpCrawler crawler,
String url,
IURLFilter filter,
RobotsTxt robotsTxt)
|
void |
IHttpCrawlerEventListener.documentURLRejected(HttpCrawler crawler,
String url,
IURLFilter filter)
|
void |
HttpCrawlerEventAdapter.documentURLRejected(HttpCrawler crawler,
String url,
IURLFilter filter)
|
void |
HttpCrawlerConfig.setURLFilters(IURLFilter[] urlFilters)
|
Uses of IURLFilter in com.norconex.collector.http.filter.impl |
---|
Classes in com.norconex.collector.http.filter.impl that implement IURLFilter | |
---|---|
class |
ExtensionURLFilter
Filters URL based on coma-separated list of file extensions. |
class |
RegexURLFilter
Filters URL based on a regular expression. |
Uses of IURLFilter in com.norconex.collector.http.robot |
---|
Methods in com.norconex.collector.http.robot that return IURLFilter | |
---|---|
IURLFilter[] |
RobotsTxt.getFilters()
|
Constructors in com.norconex.collector.http.robot with parameters of type IURLFilter | |
---|---|
RobotsTxt(IURLFilter[] filters)
|
|
RobotsTxt(IURLFilter[] filters,
float crawlDelay)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |