Concept Drift Detection Using Autoencoders in Data Streams Processing

Jaworski, Maciej and Rutkowski, Leszek and Angelov, Plamen (2020) Concept Drift Detection Using Autoencoders in Data Streams Processing. In: Artificial Intelligence and Soft Computing. Lecture Notes in Computer Science . Springer, Cham, pp. 124-133. ISBN 9783030614003

[thumbnail of Jaworski_et_al_ICAISC_2020]
Text (Jaworski_et_al_ICAISC_2020)
Jaworski_et_al_ICAISC_2020.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (314kB)

Abstract

In this paper, the problem of concept drift detection in data stream mining algorithms is considered. The autoencoder is proposed to be applied as a drift detector. The autoencoders are neural networks that are learned how to reconstruct input data. As a side effect, they are able to learn compact nonlinear codes, which summarize the most important features of input data. We suspect that the properly learned autoencoder on one part of the data stream can then be used to monitor possible changes in the following stream parts. The changes are analyzed by monitoring variations of the autoencoder cost function. Two cost functions are applied in this paper: the cross-entropy and the reconstruction error. Preliminary experimental results show that the proposed autoencoder-based detector is able to handle different types of concept drift, e.g. the sudden or the gradual. © 2020, Springer Nature Switzerland AG.

Item Type:
Contribution in Book/Report/Proceedings
Additional Information:
The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-030-61401-0_12
Subjects:
?? AUTOENCODERCONCEPT DRIFT DETECTIONDATA STREAM MININGARTIFICIAL INTELLIGENCECOST FUNCTIONSDATA MININGINPUT OUTPUT PROGRAMSLEARNING SYSTEMSSOFT COMPUTINGAUTO ENCODERSCONCEPT DRIFTSDATA STREAMS PROCESSINGDRIFT DETECTORSIMPORTANT FEATURESNONLINEAR CODESRECONS ??
ID Code:
154429
Deposited By:
Deposited On:
29 Apr 2021 13:05
Refereed?:
Yes
Published?:
Published
Last Modified:
21 Oct 2023 00:01