de.julielab.segmentationEvaluator

Class Evaluator

java.lang.Object

de.julielab.segmentationEvaluator.Evaluator

public class Evaluator
extends Object

Constructor Summary

Constructors

Constructor and Description
Evaluator()

Method Summary

Methods

Modifier and Type	Method and Description
static EvaluationResult[]	evaluate(IOToken[] gold, IOToken[] prediction)
static EvaluationResult	evaluate(IOToken[] gold, IOToken[] prediction, String label)
static EvaluationResult[]	evaluate(IOToken[] gold, IOToken[] prediction, String[] labels)
static HashMap<String,HashMap<String,String>>	getAnnotationSpans(IOToken[] taglist)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Evaluator

public Evaluator()

Method Detail

evaluate

public static EvaluationResult[] evaluate(IOToken[] gold,
                          IOToken[] prediction)

Parameters:

gold - The gold standard.

prediction - A prediction to be compared with the gold standard.

Returns:

An array of EvaluationResult object. The overall performance if found at index 0, the results for every single label follows.

evaluate

public static EvaluationResult evaluate(IOToken[] gold,
                        IOToken[] prediction,
                        String label)

Parameters:

gold - The gold standard.

prediction - A prediction to be compared with the gold standard.

label - The label of interest.

Returns:

The EvaluationResult object related to the label "label".

evaluate

public static EvaluationResult[] evaluate(IOToken[] gold,
                          IOToken[] prediction,
                          String[] labels)

Parameters:

gold - The gold standard.

prediction - A prediction to be compared with the gold standard.

labels - An array of labels of interest.

Returns:

An array of EvaluationResult objects related to the labels in "labels".

getAnnotationSpans

public static HashMap<String,HashMap<String,String>> getAnnotationSpans(IOToken[] taglist)

Parameters:

taglist - An array of IOTokens corresponding to an IO or IOB document.

Returns:

A HashMap whose keys are the labels found in the taglist. The values are HashMaps themselves whose keys are String similar to "4,9" indicating that an annotation starts at the IOToken taglist[4] and reaches until taglist[5]. The values of the "inner" HashMaps are Strings that consist of the labels in the found interval split by # characters.