Evaluation#

The evaluation module provides classes involved in model evaluation. This includes methods to evaluate a model and plot results as well as classes to define metrics used for evaluation.

Module Contents#

Object

Description

BaseEvaluator

Abstract base class for all evaluators.

DatasetMeasureEvaluator

Base class for evaluators that compute dataset-level measures.

DatasetPlotEvaluator

Base class for evaluators that create dataset-level plots.

EvaluationManager

Provides methods for evaluating models and generating plots.

EvaluatorRegistry

Registry for managing and discovering evaluators.

MeasureEvaluator

Base class for evaluators that compute model performance measures.

MetricManager

Stores MetricWrapper instances that define evaluation metrics.

MetricWrapper

Wraps a metric function and provides a convenient interface using the metric.

PlotEvaluator

Base class for evaluators that create model performance plots.