dragon.nlp.tool.xtract

Class EngWordPairIndexer

java.lang.Object

dragon.nlp.tool.xtract.EngWordPairIndexer

All Implemented Interfaces:

WordPairIndexer

public class EngWordPairIndexer
extends Object
implements WordPairIndexer

Indexer for word pair

Copyright: Copyright (c) 2005

Company: IST, Drexel University

Version:

1.0

Author:

Davis Zhou

Field Summary

Fields

Modifier and Type	Field and Description
protected IntSuperSparseMatrix[]	arrPairSentLeftMatrix
protected IntSuperSparseMatrix[]	arrPairSentRightMatrix
protected SimpleElementList	docKeyList
protected int	flushInterval
protected int	indexedNum
protected Lemmatiser	lemmatiser
protected int	maxSpan
protected WordPairGenerator	pairGenerator
protected SimplePairList	pairKeyList
protected DocumentParser	parser
protected SentenceBase	sentenceBase
protected Tagger	tagger
protected SimpleElementList	wordKeyList
protected WordPairStatList	wordpairStatList

Constructor Summary

Constructors

Constructor and Description
EngWordPairIndexer(String folder, int maxSpan, Tagger tagger, Lemmatiser lemmatiser)
EngWordPairIndexer(String folder, int maxSpan, Tagger tagger, Lemmatiser lemmatiser, WordPairGenerator pairGenerator)

Method Summary

Modifier and Type	Method and Description
void	close()
void	flush()
DocumentParser	getDocumentParser()
void	index(CollectionReader collectionReader)
boolean	indexArticle(Article curArticle)
protected void	preprocessSentence(Sentence sent) Preprocess a sentence including tagging, lemmatising and indexing.
void	setDocumentParser(DocumentParser parser)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

maxSpan

protected int maxSpan

tagger

protected Tagger tagger

lemmatiser

protected Lemmatiser lemmatiser

pairGenerator

protected WordPairGenerator pairGenerator

sentenceBase

protected SentenceBase sentenceBase

arrPairSentLeftMatrix

protected IntSuperSparseMatrix[] arrPairSentLeftMatrix

arrPairSentRightMatrix

protected IntSuperSparseMatrix[] arrPairSentRightMatrix

docKeyList

protected SimpleElementList docKeyList

wordKeyList

protected SimpleElementList wordKeyList

pairKeyList

protected SimplePairList pairKeyList

wordpairStatList

protected WordPairStatList wordpairStatList

parser

protected DocumentParser parser

flushInterval

protected int flushInterval

indexedNum

protected int indexedNum

Constructor Detail

EngWordPairIndexer

public EngWordPairIndexer(String folder,
                          int maxSpan,
                          Tagger tagger,
                          Lemmatiser lemmatiser)

EngWordPairIndexer

public EngWordPairIndexer(String folder,
                          int maxSpan,
                          Tagger tagger,
                          Lemmatiser lemmatiser,
                          WordPairGenerator pairGenerator)

Method Detail

getDocumentParser

public DocumentParser getDocumentParser()

Specified by:

getDocumentParser in interface WordPairIndexer

setDocumentParser

public void setDocumentParser(DocumentParser parser)

Specified by:

setDocumentParser in interface WordPairIndexer

close

public void close()

Specified by:

close in interface WordPairIndexer

flush

public void flush()

Specified by:

flush in interface WordPairIndexer

index

public void index(CollectionReader collectionReader)

Specified by:

index in interface WordPairIndexer

indexArticle

public boolean indexArticle(Article curArticle)

Specified by:

indexArticle in interface WordPairIndexer

preprocessSentence

protected void preprocessSentence(Sentence sent)

Preprocess a sentence including tagging, lemmatising and indexing. This method can be overrided.

Parameters:

sent - the sentence for preprocessing