Package net.sf.okapi.steps.repetitionanalysis

Class RepetitionAnalysisStep

java.lang.Object

net.sf.okapi.common.pipeline.BasePipelineStep

net.sf.okapi.steps.repetitionanalysis.RepetitionAnalysisStep

All Implemented Interfaces:

IPipelineStep

public class RepetitionAnalysisStep
extends BasePipelineStep

The step analyzes repetitions in input documents. Either exact or configurable fuzzy search is performed.

2 types of annotations are created for found repetitive segments -- RepetitiveSegmentAnnotation and AltTranslationsAnnotation. RepetitiveSegmentAnnotation's are attached to all repetitive source segments. AltTranslationsAnnotation's are attached to target segments, corresponding to repetitive source segments. AltTranslationsAnnotation is not attached for the first repetitive segment not to be counted by counting steps twice as repetitive with itself.

Constructor Summary

Constructors

Constructor	Description
RepetitionAnalysisStep()

Method Summary

Modifier and Type	Method	Description
void	cancel()
static boolean	checkSegments(Segment sseg, Segment tseg)
String	getDescription()
String	getName()
Parameters	getParameters()
protected Event	handleEndDocument(Event event)
protected Event	handleStartDocument(Event event)
protected Event	handleTextUnit(Event event)
void	setParameters(IParameters params)
void	setSourceLocale(LocaleId sourceLocale)
void	setTargetLocale(LocaleId targetLocale)

Methods inherited from class net.sf.okapi.common.pipeline.BasePipelineStep

destroy, getHelpLocation, getSourceLocale, getTargetLocale, handleCustom, handleDocumentPart, handleEndBatch, handleEndBatchItem, handleEndGroup, handleEndSubDocument, handleEndSubfilter, handleEvent, handleMultiEvent, handlePipelineParameters, handleRawDocument, handleStartBatch, handleStartBatchItem, handleStartGroup, handleStartSubDocument, handleStartSubfilter, isDone, isLastOutputStep, setLastOutputStep

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RepetitionAnalysisStep

public RepetitionAnalysisStep()

Method Detail

getName

public String getName()

getDescription

public String getDescription()

getParameters

public Parameters getParameters()

Specified by:

getParameters in interface IPipelineStep

Overrides:

getParameters in class BasePipelineStep

cancel

public void cancel()

Specified by:

cancel in interface IPipelineStep

Overrides:

cancel in class BasePipelineStep

setParameters

public void setParameters(IParameters params)

Specified by:

setParameters in interface IPipelineStep

Overrides:

setParameters in class BasePipelineStep

setSourceLocale

public void setSourceLocale(LocaleId sourceLocale)

Specified by:

setSourceLocale in interface IPipelineStep

Overrides:

setSourceLocale in class BasePipelineStep

setTargetLocale

public void setTargetLocale(LocaleId targetLocale)

Specified by:

setTargetLocale in interface IPipelineStep

Overrides:

setTargetLocale in class BasePipelineStep

handleStartDocument

protected Event handleStartDocument(Event event)

Overrides:

handleStartDocument in class BasePipelineStep

handleEndDocument

protected Event handleEndDocument(Event event)

Overrides:

handleEndDocument in class BasePipelineStep

checkSegments

public static boolean checkSegments(Segment sseg,
                                    Segment tseg)

handleTextUnit

protected Event handleTextUnit(Event event)

Overrides:

handleTextUnit in class BasePipelineStep