Concept Drift Detection Using Autoencoders in Data Streams Processing

Jaworski, Maciej and Rutkowski, Leszek and Angelov, Plamen (2020) Concept Drift Detection Using Autoencoders in Data Streams Processing. In: Artificial Intelligence and Soft Computing. Lecture Notes in Computer Science . Springer, Cham, pp. 124-133. ISBN 9783030614003

Text (Jaworski_et_al_ICAISC_2020)
Jaworski_et_al_ICAISC_2020.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (314kB)


In this paper, the problem of concept drift detection in data stream mining algorithms is considered. The autoencoder is proposed to be applied as a drift detector. The autoencoders are neural networks that are learned how to reconstruct input data. As a side effect, they are able to learn compact nonlinear codes, which summarize the most important features of input data. We suspect that the properly learned autoencoder on one part of the data stream can then be used to monitor possible changes in the following stream parts. The changes are analyzed by monitoring variations of the autoencoder cost function. Two cost functions are applied in this paper: the cross-entropy and the reconstruction error. Preliminary experimental results show that the proposed autoencoder-based detector is able to handle different types of concept drift, e.g. the sudden or the gradual. © 2020, Springer Nature Switzerland AG.

Item Type:
Contribution in Book/Report/Proceedings
Additional Information:
The final publication is available at Springer via
ID Code:
Deposited By:
Deposited On:
29 Apr 2021 13:05
Last Modified:
18 Sep 2023 02:46