de.l3s.icrawl.crawler.io

Class CsvStorer

java.lang.Object

de.l3s.icrawl.crawler.io.CsvStorer

All Implemented Interfaces:

ResultStorer, Closeable, AutoCloseable

public class CsvStorer
extends Object
implements ResultStorer, Closeable

Nested Class Summary

Nested classes/interfaces inherited from interface de.l3s.icrawl.crawler.io.ResultStorer

ResultStorer.Factory

Field Summary

Fields inherited from interface de.l3s.icrawl.crawler.io.ResultStorer

OUTPUT_DIRECTORY

Constructor Summary

Constructors

Constructor and Description
CsvStorer(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path outputFile)

Method Summary

Modifier and Type	Method and Description
void	close()
void	store(CrawledResource resource)
void	storeNotFound(CrawlUrl url)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CsvStorer

public CsvStorer(org.apache.hadoop.conf.Configuration conf,
                 org.apache.hadoop.fs.Path outputFile)
          throws IOException

Throws:

IOException

Method Detail

store

public void store(CrawledResource resource)

Specified by:

store in interface ResultStorer

storeNotFound

public void storeNotFound(CrawlUrl url)

Specified by:

storeNotFound in interface ResultStorer

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException