tpcp.validate: Validation helper#

Module for all helper methods to evaluate algorithms.

Classes#

Scorer(score_func, ~tpcp._dataset.DatasetT], ...)

A scorer to score multiple data points of a dataset and average the results.

Aggregator(_value)

Base class for aggregators.

MeanAggregator(_value)

Aggregator that calculates the mean of the values.

NoAgg(_value)

Wrapper to wrap one or multiple output values of a scorer to prevent aggregation of these values.

Functions#

cross_validate(optimizable, dataset, *[, ...])

Evaluate a pipeline on a dataset using cross validation.

validate(pipeline, dataset, *[, scoring, ...])

Evaluate a pipeline on a dataset without any optimization.