module prediction.evaluation.measures.mean_drift_performance_deterioration

Drift Performance Deterioration Measure.

This function returns the drift performance deterioration. This measure corresponds to the mean difference of a performance measure before and after a known concept drift. It is hence a measure to quantify the adaptability of a predictor under concept drift.

Copyright (C) 2022 Johannes Haug.

function mean_drift_performance_deterioration

mean_drift_performance_deterioration(
    result: dict,
    known_drifts: Union[List[int], List[tuple]],
    batch_size: int,
    reference_measure: Callable = <function zero_one_loss at 0x11d1669d0>,
    reference_measure_kwargs: Optional[dict] = None,
    interval: int = 10
) → float

Calculates the mean performance deterioration after kown concept drifts.

Args:

  • result: A result dictionary from the PredictionEvaluator object.
  • known_drifts: The positions in the dataset (indices) corresponding to known concept drifts.
  • batch_size: The number of observations processed per iteration/time step.
  • reference_measure: Evaluation measure function.
  • reference_measure_kwargs: Keyword arguments of the reference measure. This attribute is maintained for consistency reasons, but is not used by this performance measure.
  • interval: Scalar specifying the size of the interval (i.e. number of time steps) after known concept drift, in which we investigate a performance decay of the reference measure.

Returns:

  • float: Current mean performance deterioration after (known) concept drifts regarding the reference measure.

This file was automatically generated via lazydocs.