de.gerdiproject.harvest.etls.loaders

Class AbstractIteratorLoader<S>

java.lang.Object

de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader<S>

Type Parameters:

S - the type of the documents to be loaded

All Implemented Interfaces:

ILoader<Iterator<S>>

Direct Known Subclasses:

AbstractURLLoader, DiskLoader

public abstract class AbstractIteratorLoader<S>
extends Object
implements ILoader<Iterator<S>>

This loader can load multiple documents.

Author:

Robin Weiss

Field Summary

Fields

Modifier and Type	Field and Description
protected AbstractIteratorETL<?,?>	dedicatedEtl
protected boolean	hasLoadedDocuments

Constructor Summary

Constructors

Constructor and Description
AbstractIteratorLoader()

Method Summary

Modifier and Type	Method and Description
void	init(AbstractETL<?,?> etl) Initializes the loader for a new harvest.
void	load(Iterator<S> documents) Loads the document to a targeted search index.
protected abstract void	loadElement(S document) Loads a single element of the Iterator.
protected void	loadElementAndIncrement(S document) Loads a single element of the Iterator and increments the number of harvested documents of the dedicated harvester, regardless of whether the loading succeeded or not.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface de.gerdiproject.harvest.etls.loaders.ILoader

clear, unregisterParameters

Field Detail

dedicatedEtl

protected AbstractIteratorETL<?,?> dedicatedEtl

hasLoadedDocuments

protected boolean hasLoadedDocuments

Constructor Detail

AbstractIteratorLoader

public AbstractIteratorLoader()

Method Detail

init

public void init(AbstractETL<?,?> etl)

Description copied from interface: ILoader

Initializes the loader for a new harvest.

Specified by:

init in interface ILoader<Iterator<S>>

Parameters:

etl - the AbstractETL to which the loader belongs

load

public void load(Iterator<S> documents)
          throws LoaderException

Description copied from interface: ILoader

Loads the document to a targeted search index.

Specified by:

load in interface ILoader<Iterator<S>>

Parameters:

documents - the document that is to be loaded

Throws:

LoaderException - when the load did not work properly

loadElementAndIncrement

protected void loadElementAndIncrement(S document)
                                throws LoaderException

Loads a single element of the Iterator and increments the number of harvested documents of the dedicated harvester, regardless of whether the loading succeeded or not.

Parameters:

document - a document that is to be loaded

Throws:

LoaderException - when the load failed

loadElement

protected abstract void loadElement(S document)
                             throws LoaderException

Loads a single element of the Iterator.

Parameters:

document - a document that is to be loaded

Throws:

LoaderException - when the load failed