evaluation
Class Evaluator

java.lang.Object
  evaluation.Evaluator

public class Evaluator
extends java.lang.Object

Nested Class Summary

static class

Evaluator.Sorting

Constructor Summary

Evaluator()

Method Summary

java.util.Collection<SingleMethodEvaluation>	evaluate(corpusapi.Corpus corpus, AnnotationReader annotationReader, corpusapi.tei.TEISenseInventory dict)
void	printEvaluationResults(java.io.BufferedWriter bw, java.util.Collection<SingleMethodEvaluation> smes, AnnotationStats goldenStandard) Prints evaluation results to a given writer.
void	printEvaluationResultsOnLexemes(java.io.Writer w, java.util.Collection<SingleMethodEvaluation> results, AnnotationStats goldenStandard) Prints evaluation results to a given writer.
java.util.Collection<SingleMethodEvaluation>	selectBestMethods(java.util.Collection<SingleMethodEvaluation> results, Evaluator.Sorting sortingType, java.lang.Integer howMany, AnnotationStats goldenStandard) Selects best methods from a method evaluation list.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Evaluator

public Evaluator()

Method Detail

evaluate

public java.util.Collection<SingleMethodEvaluation> evaluate(corpusapi.Corpus corpus,
                                                             AnnotationReader annotationReader,
                                                             corpusapi.tei.TEISenseInventory dict)

printEvaluationResults

public void printEvaluationResults(java.io.BufferedWriter bw,
                                   java.util.Collection<SingleMethodEvaluation> smes,
                                   AnnotationStats goldenStandard)
                            throws java.io.IOException

Prints evaluation results to a given writer.

Parameters:

bw - writer to output results

smes - method evaluations

goldenStandard -

Throws:

java.io.IOException

printEvaluationResultsOnLexemes

public void printEvaluationResultsOnLexemes(java.io.Writer w,
                                            java.util.Collection<SingleMethodEvaluation> results,
                                            AnnotationStats goldenStandard)
                                     throws java.io.IOException

Prints evaluation results to a given writer. Each row is organized as follows: lexeme, baseline for lexeme, results for this lexeme of all methods

Parameters:

w - writer

results - method evaluations

goldenStandard -

Throws:

java.io.IOException

selectBestMethods

public java.util.Collection<SingleMethodEvaluation> selectBestMethods(java.util.Collection<SingleMethodEvaluation> results,
                                                                      Evaluator.Sorting sortingType,
                                                                      java.lang.Integer howMany,
                                                                      AnnotationStats goldenStandard)

Selects best methods from a method evaluation list.

Parameters:

results - methods evaluations to chose from

sortingType - type of comparison

howMany - how many best to select

goldenStandard - for comparement to mfs

Returns:

selected methods