public class TokenizationStep
extends net.sf.okapi.lib.extra.steps.AbstractPipelineStep
| Modifier and Type | Field and Description |
|---|---|
static int |
RAWTEXT |
| Constructor and Description |
|---|
TokenizationStep() |
| Modifier and Type | Method and Description |
|---|---|
protected void |
component_init() |
boolean |
exec(Object sender,
String command,
Object info) |
String |
getConfigInfo() |
List<LexerRule> |
getIdleRules() |
List<ILexer> |
getLexers() |
protected Event |
handleTextUnit(Event event) |
void |
setConfiguration(Class<?> classRef,
String configLocation) |
void |
setLexers(List<ILexer> lexers) |
cancel, destroy, getHelpLocation, getSourceLocale, getTargetLocale, handleCustom, handleDocumentPart, handleEndBatch, handleEndBatchItem, handleEndDocument, handleEndGroup, handleEndSubDocument, handleEndSubfilter, handleEvent, handleMultiEvent, handlePipelineParameters, handleRawDocument, handleStartBatch, handleStartBatchItem, handleStartDocument, handleStartGroup, handleStartSubDocument, handleStartSubfilter, isDone, isLastOutputStep, setLastOutputStep, setSourceLocale, setTargetLocalecomponent_done, getParameters, getParameters, getParametersClassName, setParametersgetDescription, getName, setDescription, setName, toStringclone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, waitgetDescription, getName, getParameters, setParameterspublic static final int RAWTEXT
protected void component_init()
component_init in class net.sf.okapi.lib.extra.OkapiComponentpublic boolean exec(Object sender, String command, Object info)
exec in interface net.sf.okapi.lib.extra.INotifiableexec in class net.sf.okapi.lib.extra.Componentprotected Event handleTextUnit(Event event)
handleTextUnit in class net.sf.okapi.lib.extra.steps.AbstractPipelineSteppublic String getConfigInfo()
Copyright © 2019. All rights reserved.