dragon.nlp.extract

Class EngDocumentParser

java.lang.Object

dragon.nlp.extract.EngDocumentParser

All Implemented Interfaces:

DocumentParser

Direct Known Subclasses:

CnSimpleDocumentParser

public class EngDocumentParser
extends Object
implements DocumentParser

Document Parser for English Text

Copyright: Copyright (c) 2005

Company: IST, Drexel University

Version:

1.0

Author:

Davis Zhou

Field Summary

Fields

Modifier and Type	Field and Description
static String	defParaDelimitor
static String	defSentDelimitor
static String	defWordDelimitor
protected String	paraDelimitor
static String	punctuations
protected String	sentDelimitor
protected String	wordDelimitor

Constructor Summary

Constructors

Constructor and Description
EngDocumentParser()
EngDocumentParser(String wordDelimitor)

Method Summary

Modifier and Type	Method and Description
protected int	isApostrophesAsWord(int apoPos, int startPos, String context)
protected boolean	isNumber(String str)
protected boolean	isPeriodAsToken(int periodPos, int startPos, String context)
protected boolean	isPeriodAsWord(int periodPos, int startPos, String context)
protected boolean	isSentencePeriod(int pos, String context)
Document	parse(String doc) Parses a text into a Document object
Paragraph	parseParagraph(String paragraph) Parses a text into a Paragraph object
Sentence	parseSentence(String sentence) Parses a text into a Sentence object
ArrayList	parseTokens(String content) Prases a text into a sequence of tokens.
protected Word	parseWord(String content)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

defParaDelimitor

public static final String defParaDelimitor

See Also:

Constant Field Values

defSentDelimitor

public static final String defSentDelimitor

See Also:

Constant Field Values

defWordDelimitor

public static final String defWordDelimitor

See Also:

Constant Field Values

punctuations

public static final String punctuations

See Also:

Constant Field Values

wordDelimitor

protected String wordDelimitor

paraDelimitor

protected String paraDelimitor

sentDelimitor

protected String sentDelimitor

Constructor Detail

EngDocumentParser

public EngDocumentParser()

EngDocumentParser

public EngDocumentParser(String wordDelimitor)

Method Detail

parse

public Document parse(String doc)

Description copied from interface: DocumentParser

Parses a text into a Document object

Specified by:

parse in interface DocumentParser

Parameters:

doc - the text for parsing

Returns:

a document object

parseParagraph

public Paragraph parseParagraph(String paragraph)

Description copied from interface: DocumentParser

Parses a text into a Paragraph object

Specified by:

parseParagraph in interface DocumentParser

Parameters:

paragraph - the text for parsing

Returns:

a paragraph object

parseSentence

public Sentence parseSentence(String sentence)

Description copied from interface: DocumentParser

Parses a text into a Sentence object

Specified by:

parseSentence in interface DocumentParser

Parameters:

sentence - the text for parsing

Returns:

a Sentence object

parseWord

protected Word parseWord(String content)

parseTokens

public ArrayList parseTokens(String content)

Description copied from interface: DocumentParser

Prases a text into a sequence of tokens. Tokens are in the original format and order. No stem is applied. Duplicated tokens are not merged.

Specified by:

parseTokens in interface DocumentParser

Parameters:

content - the text for parsing

Returns:

a list of tokens in the format of String

isPeriodAsWord

protected boolean isPeriodAsWord(int periodPos,
                                 int startPos,
                                 String context)

isPeriodAsToken

protected boolean isPeriodAsToken(int periodPos,
                                  int startPos,
                                  String context)

isApostrophesAsWord

protected int isApostrophesAsWord(int apoPos,
                                  int startPos,
                                  String context)

isSentencePeriod

protected boolean isSentencePeriod(int pos,
                                   String context)

isNumber

protected boolean isNumber(String str)