edu.umass.cs.mallet.projects.seg_plus_coref.ie

Class MultiSegmentationEvaluator

java.lang.Object

edu.umass.cs.mallet.base.fst.TransducerEvaluator

edu.umass.cs.mallet.projects.seg_plus_coref.ie.MultiSegmentationEvaluator

public class MultiSegmentationEvaluator
extends TransducerEvaluator

Field Summary

Fields inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator

printModelAtEnd

Constructor Summary

Constructors

Constructor and Description
MultiSegmentationEvaluator(Object[] segmentStartTags, Object[] segmentContinueTags)
MultiSegmentationEvaluator(Object[] segmentStartTags, Object[] segmentContinueTags, String viterbiOutputFilePrefix, int viterbiOutputIterationsToSkip)

Method Summary

Modifier and Type	Method and Description
boolean	evaluate(Transducer crf, boolean finishedTraining, int iteration, boolean converged, double cost, InstanceList training, InstanceList validation, InstanceList testing) Evaluates a Tranducers on a given training, validation, and testing set.
int	getEvalIterations()
void	test(Transducer transducer, InstanceList data, String description, PrintStream viterbiOutputStream)

Methods inherited from class edu.umass.cs.mallet.base.fst.TransducerEvaluator

getCheckpointFilePrefix, getCheckpointIterationsToSkip, getCheckpointTransducer, getNumIterationsToSkip, getNumIterationsToWait, getViterbiOutput, getViterbiOutputEncoding, getViterbiOutputFilePrefix, getViterbiOutputIterationsToSkip, getViterbiOutputIterationsToWait, isAlwaysEvaluateWhenFinished, isPrintModelAtEnd, setAlwaysEvaluateWhenFinished, setCheckpointFilePrefix, setCheckpointIterationsToSkip, setCheckpointTransducer, setNumIterationsToSkip, setNumIterationsToWait, setPrintModelAtEnd, setViterbiOutput, setViterbiOutputEncoding, setViterbiOutputFilePrefix, setViterbiOutputIterationsToSkip, setViterbiOutputIterationsToWait, shouldDoEvaluate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiSegmentationEvaluator

public MultiSegmentationEvaluator(Object[] segmentStartTags,
                                  Object[] segmentContinueTags)

MultiSegmentationEvaluator

public MultiSegmentationEvaluator(Object[] segmentStartTags,
                                  Object[] segmentContinueTags,
                                  String viterbiOutputFilePrefix,
                                  int viterbiOutputIterationsToSkip)

Method Detail

getEvalIterations

public int getEvalIterations()

test

public void test(Transducer transducer,
                 InstanceList data,
                 String description,
                 PrintStream viterbiOutputStream)

Specified by:

test in class TransducerEvaluator

evaluate

public boolean evaluate(Transducer crf,
                        boolean finishedTraining,
                        int iteration,
                        boolean converged,
                        double cost,
                        InstanceList training,
                        InstanceList validation,
                        InstanceList testing)

Description copied from class: TransducerEvaluator

Evaluates a Tranducers on a given training, validation, and testing set. .

The default implementation calls the evaluator's test on the training, validation, and testing sets.

Overrides:

evaluate in class TransducerEvaluator

Parameters:

crf - The transducer to evaluate.

finishedTraining - Whether training has finished. Evaluators can be set to always evaluate when training completes.

iteration - The current iteration

converged - Whether training has converged. Most evaluators ignore this.

cost - The current cost during training. Some evaluators may include this in the output.

training - The training set. If null, the argument is ignored.

validation - The validation set. If null, the argument is ignored.

testing - The testing set. If null, the argument is ignored.

Returns:

Whether training should continue.