com.norconex.collector.http.crawler
Class URLProcessor

java.lang.Object
  extended by com.norconex.collector.http.crawler.URLProcessor

public class URLProcessor
extends Object

Holds the URL processing logic in various processing "step" for better readability and maintainability. Instances are only valid for the scope of processing a URL.

Author:
Pascal Essiembre

Nested Class Summary
static interface URLProcessor.IURLProcessingStep
           
 
Constructor Summary
URLProcessor(HttpCrawler crawler, org.apache.http.impl.client.DefaultHttpClient httpClient, ICrawlURLDatabase database, File outputFile, HttpDocument doc, CrawlURL crawlURL)
           
 
Method Summary
 boolean processURL()
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

URLProcessor

public URLProcessor(HttpCrawler crawler,
                    org.apache.http.impl.client.DefaultHttpClient httpClient,
                    ICrawlURLDatabase database,
                    File outputFile,
                    HttpDocument doc,
                    CrawlURL crawlURL)
Method Detail

processURL

public boolean processURL()


Copyright © 2009-2013 Norconex Inc.. All Rights Reserved.