|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use com.norconex.collector.http.handler | |
---|---|
com.norconex.collector.http.crawler | |
com.norconex.collector.http.handler.impl |
Classes in com.norconex.collector.http.handler used by com.norconex.collector.http.crawler | |
---|---|
IDelayResolver
Resolves and creates "delays" between each document crawled. |
|
IHttpClientInitializer
Initializes an HTTP Connection. |
|
IHttpDocumentChecksummer
|
|
IHttpDocumentFetcher
Fetches the HTTP document and its metadata (HTTP Headers). |
|
IHttpDocumentProcessor
Custom processing (optional) performed on a document. |
|
IHttpHeadersChecksummer
|
|
IHttpHeadersFetcher
Fetches the HTTP Header, typically via a HEAD request. |
|
IRobotsTxtProvider
Given a URL, extract any "robots.txt" rules. |
|
IURLExtractor
Responsible for extracting URLs out of a document. |
|
IURLNormalizer
Responsible for normalizing URLs. |
Classes in com.norconex.collector.http.handler used by com.norconex.collector.http.handler.impl | |
---|---|
IDelayResolver
Resolves and creates "delays" between each document crawled. |
|
IHttpClientInitializer
Initializes an HTTP Connection. |
|
IHttpDocumentChecksummer
|
|
IHttpDocumentFetcher
Fetches the HTTP document and its metadata (HTTP Headers). |
|
IHttpHeadersChecksummer
|
|
IHttpHeadersFetcher
Fetches the HTTP Header, typically via a HEAD request. |
|
IRobotsTxtProvider
Given a URL, extract any "robots.txt" rules. |
|
IURLExtractor
Responsible for extracting URLs out of a document. |
|
IURLNormalizer
Responsible for normalizing URLs. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |