Package com.norconex.collector.http.handler

Interface Summary
IDelayResolver Resolves and creates "delays" between each document crawled.
IHttpClientInitializer Initializes an HTTP Connection.
IHttpDocumentChecksummer  
IHttpDocumentFetcher Fetches the HTTP document and its metadata (HTTP Headers).
IHttpDocumentProcessor Custom processing (optional) performed on a document.
IHttpHeadersChecksummer  
IHttpHeadersFetcher Fetches the HTTP Header, typically via a HEAD request.
IRobotsMetaBuilder  
IRobotsTxtProvider Given a URL, extract any "robots.txt" rules.
IURLExtractor Responsible for extracting URLs out of a document.
IURLNormalizer Responsible for normalizing URLs.
 



Copyright © 2009-2013 Norconex Inc.. All Rights Reserved.