edu.umass.cs.mallet.base.types

Class TokenSequence

java.lang.Object

edu.umass.cs.mallet.base.types.TokenSequence

All Implemented Interfaces:

PipeOutputAccumulator, Sequence, Serializable

Direct Known Subclasses:

StringTokenization

public class TokenSequence
extends Object
implements PipeOutputAccumulator, Sequence, Serializable

A representation of a piece of text, usually a single word, to which we can attach properties.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
TokenSequence()
TokenSequence(Collection tokens)
TokenSequence(int capacity)
TokenSequence(Object[] tokens)
TokenSequence(Token[] tokens)

Method Summary

Modifier and Type	Method and Description
void	add(Object o)
void	add(Token t)
void	addAll(Object[] tokens)
void	addAll(Token[] tokens)
void	addAll(TokenSequence ts)
PipeOutputAccumulator	clonePipeOutputAccumulator()
Object	get(int i)
double	getNumericProperty(String key)
Object	getProperty(String key)
Token	getToken(int i)
boolean	hasProperty(String key)
Iterator	iterator()
void	pipeOutputAccumulate(Instance carrier, Pipe iteratedPipe)
Object	remove(int index)
Object	removeLastToken()
void	setNumericProperty(String key, double value)
void	setProperty(String key, Object value)
int	size()
FeatureSequence	toFeatureSequence(Alphabet dict)
FeatureVector	toFeatureVector(Alphabet dict)
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

TokenSequence

public TokenSequence(Collection tokens)

TokenSequence

public TokenSequence()

TokenSequence

public TokenSequence(int capacity)

TokenSequence

public TokenSequence(Token[] tokens)

TokenSequence

public TokenSequence(Object[] tokens)

Method Detail

size

public int size()

Specified by:

size in interface Sequence

toString

public String toString()

Overrides:

toString in class Object

getToken

public Token getToken(int i)

get

public Object get(int i)

Specified by:

get in interface Sequence

add

public void add(Object o)

add

public void add(Token t)

remove

public Object remove(int index)

removeLastToken

public Object removeLastToken()

addAll

public void addAll(TokenSequence ts)

addAll

public void addAll(Token[] tokens)

addAll

public void addAll(Object[] tokens)

iterator

public Iterator iterator()

pipeOutputAccumulate

public void pipeOutputAccumulate(Instance carrier,
                                 Pipe iteratedPipe)

Specified by:

pipeOutputAccumulate in interface PipeOutputAccumulator

clonePipeOutputAccumulator

public PipeOutputAccumulator clonePipeOutputAccumulator()

Specified by:

clonePipeOutputAccumulator in interface PipeOutputAccumulator

toFeatureSequence

public FeatureSequence toFeatureSequence(Alphabet dict)

toFeatureVector

public FeatureVector toFeatureVector(Alphabet dict)

setNumericProperty

public void setNumericProperty(String key,
                               double value)

setProperty

public void setProperty(String key,
                        Object value)

getNumericProperty

public double getNumericProperty(String key)

getProperty

public Object getProperty(String key)

hasProperty

public boolean hasProperty(String key)