de.datexis.ner.eval

Class MentionAnnotatorEval

java.lang.Object

de.datexis.evaluation.ModelEvaluation

de.datexis.ner.eval.MentionAnnotatorEval

Deprecated.

@Deprecated
public class MentionAnnotatorEval
extends ModelEvaluation

Evaluates Precision/Recall/F1 for span-based annotation (e.g. NER)

Author:

sarnold

Nested Class Summary

Nested classes/interfaces inherited from class de.datexis.evaluation.ModelEvaluation

ModelEvaluation.Measure

Field Summary

Fields inherited from class de.datexis.evaluation.ModelEvaluation

counts, experimentId, experimentName, test, testCount, testTime, train, trainCount, trainTime

Constructor Summary

Constructors

Constructor and Description
MentionAnnotatorEval(String experimentName) Deprecated.
MentionAnnotatorEval(String experimentName, Annotation.Source expected, Annotation.Source predicted) Deprecated.
MentionAnnotatorEval(String experimentName, Dataset train, Dataset test) Deprecated.

Method Summary

Modifier and Type	Method and Description
void	clear() Deprecated.
void	evaluateAnnotations() Deprecated.
double	f1() Deprecated.
double	getFN() Deprecated.
double	getFP() Deprecated.
double	getMicroF1(Dataset data) Deprecated. This is CoNLL2003 NER-style F1 $FB1 = 2*$precision*$recall/($precision+$recall) if ($precision+$recall > 0);
double	getMicroRecall(Dataset data) Deprecated. This is the CoNLL2003 Recall
double	getTAccuracy(Dataset data) Deprecated. This is CoNLL2003 Accuracy
double	getTN() Deprecated.
double	getTP() Deprecated.
double	precision() Deprecated.
String	printAnnotationStats() Deprecated.
double	recall() Deprecated.

Methods inherited from class de.datexis.evaluation.ModelEvaluation

div, fDbl, fInt, printDatasetStats, printExperimentStats, seqL, setExperimentName, setTestDataset, setTrainDataset, startTestTimer, startTrainTimer, stopTestTimer, stopTrainTimer

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MentionAnnotatorEval

public MentionAnnotatorEval(String experimentName)

Deprecated.

MentionAnnotatorEval

public MentionAnnotatorEval(String experimentName,
                            Annotation.Source expected,
                            Annotation.Source predicted)

Deprecated.

MentionAnnotatorEval

@Deprecated
public MentionAnnotatorEval(String experimentName,
                                        Dataset train,
                                        Dataset test)

Deprecated.

Method Detail

clear

public void clear()

Deprecated.

Overrides:

clear in class ModelEvaluation

evaluateAnnotations

public void evaluateAnnotations()

Deprecated.

getTP

public double getTP()

Deprecated.

getFP

public double getFP()

Deprecated.

getTN

public double getTN()

Deprecated.

getFN

public double getFN()

Deprecated.

precision

public double precision()

Deprecated.

recall

public double recall()

Deprecated.

getMicroRecall

public double getMicroRecall(Dataset data)

Deprecated.

This is the CoNLL2003 Recall

Parameters:

data -

Returns:

recall = correctChunk / foundCorrect

getTAccuracy

public double getTAccuracy(Dataset data)

Deprecated.

This is CoNLL2003 Accuracy

Parameters:

data -

Returns:

accuracy = correctTags / tokenCounter

f1

public double f1()

Deprecated.

getMicroF1

public double getMicroF1(Dataset data)

Deprecated.

This is CoNLL2003 NER-style F1 $FB1 = 2*$precision*$recall/($precision+$recall) if ($precision+$recall > 0);

Parameters:

data -

Returns:

printAnnotationStats

public String printAnnotationStats()

Deprecated.

Overrides:

printAnnotationStats in class ModelEvaluation