de.datexis.parvec.encoder

Class ParVecIterator

java.lang.Object

de.datexis.parvec.encoder.ParVecIterator

All Implemented Interfaces:

org.deeplearning4j.text.sentenceiterator.labelaware.LabelAwareSentenceIterator, org.deeplearning4j.text.sentenceiterator.SentenceIterator

public class ParVecIterator
extends Object
implements org.deeplearning4j.text.sentenceiterator.labelaware.LabelAwareSentenceIterator

An iterator that iterates over Sections (not Sentences).

Author:

Sebastian Arnold

Field Summary

Fields

Modifier and Type	Field and Description
protected Iterator<SectionAnnotation>	annIt
protected int	batchSize
protected Document	currentDoc
protected SectionAnnotation	currentSection
protected Iterator<Document>	docIt
protected List<Document>	documents
protected static org.slf4j.Logger	log
protected boolean	randomize
protected List<SectionAnnotation>	sections

Constructor Summary

Constructors

Constructor and Description
ParVecIterator(Collection<Document> docs, boolean randomize)
ParVecIterator(Dataset data, boolean randomize)

Method Summary

Modifier and Type	Method and Description
String	currentLabel()
List<String>	currentLabels()
void	finish()
org.deeplearning4j.text.sentenceiterator.SentencePreProcessor	getPreProcessor()
boolean	hasNext()
protected boolean	hasNextDocument()
protected boolean	hasNextSection()
void	nextDocument()
String	nextSentence()
void	reset()
void	setPreProcessor(org.deeplearning4j.text.sentenceiterator.SentencePreProcessor preProcessor)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

protected static final org.slf4j.Logger log

documents

protected List<Document> documents

docIt

protected Iterator<Document> docIt

currentDoc

protected Document currentDoc

sections

protected List<SectionAnnotation> sections

annIt

protected Iterator<SectionAnnotation> annIt

currentSection

protected SectionAnnotation currentSection

batchSize

protected int batchSize

randomize

protected boolean randomize

Constructor Detail

ParVecIterator

public ParVecIterator(Dataset data,
                      boolean randomize)

ParVecIterator

public ParVecIterator(Collection<Document> docs,
                      boolean randomize)

Method Detail

reset

public void reset()

Specified by:

reset in interface org.deeplearning4j.text.sentenceiterator.SentenceIterator

hasNext

public boolean hasNext()

Specified by:

hasNext in interface org.deeplearning4j.text.sentenceiterator.SentenceIterator

hasNextSection

protected boolean hasNextSection()

hasNextDocument

protected boolean hasNextDocument()

nextDocument

public void nextDocument()

nextSentence

public String nextSentence()

Specified by:

nextSentence in interface org.deeplearning4j.text.sentenceiterator.SentenceIterator

currentLabel

public String currentLabel()

Specified by:

currentLabel in interface org.deeplearning4j.text.sentenceiterator.labelaware.LabelAwareSentenceIterator

currentLabels

public List<String> currentLabels()

Specified by:

currentLabels in interface org.deeplearning4j.text.sentenceiterator.labelaware.LabelAwareSentenceIterator

finish

public void finish()

Specified by:

finish in interface org.deeplearning4j.text.sentenceiterator.SentenceIterator

getPreProcessor

public org.deeplearning4j.text.sentenceiterator.SentencePreProcessor getPreProcessor()

Specified by:

getPreProcessor in interface org.deeplearning4j.text.sentenceiterator.SentenceIterator

setPreProcessor

public void setPreProcessor(org.deeplearning4j.text.sentenceiterator.SentencePreProcessor preProcessor)

Specified by:

setPreProcessor in interface org.deeplearning4j.text.sentenceiterator.SentenceIterator