tpcp.validate: Validation helper#

Module for all helper methods to evaluate algorithms.

Classes#

Scorer(score_func, *[, single_score_callback])

A scorer to score multiple data points of a dataset and average the results.

NoAgg(_value)

Wrapper to wrap one or multiple output values of a scorer to prevent aggregation of these values.

Functions#

cross_validate(optimizable, dataset, *[, ...])

Evaluate a pipeline on a dataset using cross validation.

aggregate_scores()

Invert result dict of and apply aggregation method to each score output.