Skip to content
Publications

Article · Algorithms · November 7, 2026

Using Information on Influencing Factors to Partition Training Samples for Classification Under Changing Operating Conditions

Nurzhan Bazhayev, Leila Rzayeva, Madi Shayakhmetov, Ilya Lebedev, Babyr Rzayev

Abstract

Training samples collected from operating systems are rarely homogeneous: seasons, working calendars, and scheduled events shift variable ranges, change class frequencies, and increase class overlap. The periods during which such factors act are often known in advance but are ignored when samples are formed. This paper formalises a factor-induced partition of the training sample with rules for selecting factors, shows that knowledge of the regime cannot increase the Bayes error, and derives a finite-sample condition under which partitioning pays, together with its relation to supplying the regime as an input feature. On two electricity streams with recovered calendars, seven classifiers, and protocols in which all methods predict identical records, partitioning beats the pooled model in 40 of 42 cells by up to 6.5 percentage points, but beats a pooled model given the regime as a feature by only 1.1 points for parametric and 0.1 for flexible classifiers. Where the calendar explains the change, partitioning outperforms DDM, ADWIN, and adaptive random forests in prequential evaluation; where unexplained drift dominates, reactive methods are better. A minimum subsample size prevents losses from over-refinement, and a pilot estimate of the heterogeneity gap predicts the benefit of partitioning better than the silhouette coefficient.

Data Stream Mining TechniquesTime Series Analysis and ForecastingEnergy Load and Power Forecasting

More by Nurzhan Bazhayev