net.sf.okapi.steps.tokenization.common

Class Token

java.lang.Object

net.sf.okapi.steps.tokenization.common.Token

public class Token
extends Object

Version:

0.1 08.07.2009

Constructor Summary

Constructors

Constructor and Description
Token(int tokenId, Lexem lexem, int score)

Method Summary

Modifier and Type	Method and Description
void	delete()
String	getDescription()
Lexem	getLexem()
int	getLexemId()
int	getLexerId()
String	getName()
Range	getRange()
int	getScore()
int	getTokenId() Gets integer identifier of the token.
String	getValue()
boolean	isDeleted()
boolean	isImmutable()
void	setDeleted(boolean deleted)
void	setImmutable(boolean immutable)
void	setScore(int score)
String	toString()
void	undelete()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Token

public Token(int tokenId,
             Lexem lexem,
             int score)

Method Detail

getTokenId

public int getTokenId()

Gets integer identifier of the token. !!! Non-serializable.

getLexem

public Lexem getLexem()

getRange

public Range getRange()

getScore

public int getScore()

getLexerId

public int getLexerId()

getLexemId

public int getLexemId()

getValue

public String getValue()

getName

public String getName()

getDescription

public String getDescription()

toString

public String toString()

Overrides:

toString in class Object

setScore

public void setScore(int score)

isImmutable

public boolean isImmutable()

setImmutable

public void setImmutable(boolean immutable)

setDeleted

public void setDeleted(boolean deleted)

isDeleted

public boolean isDeleted()

delete

public void delete()

undelete

public void undelete()