Interpolating the missing values for multi-dimensional spatial-temporal sensor data : A tensor SVD approach

Xu, Peipei and Ruan, Wenjie and Sheng, Quan Z. and Gu, Tao and Yao, Lina (2017) Interpolating the missing values for multi-dimensional spatial-temporal sensor data : A tensor SVD approach. In: 14th EAI International Conference on Mobile and Ubiquitous Systems : Computing, Networking and Services, MobiQuitous 2017. Association for Computing Machinery (ACM), AUS, pp. 442-451. ISBN 9781450353687

Abstract

With the booming of the Internet of Things, enormous number of smart devices/sensors have been deployed in the physical world to monitor our surroundings. Usually those devices generate high-dimensional geo-tagged time-series data. However, these sensor readings are easily missing due to the hardware malfunction, connection errors or data corruption, which severely compromise the back-end data analysis. To solve this problem, in this paper we exploit tensor-based Singular Value Decomposition method to recover the missing sensor readings. The main novelty of this paper lies in that, i) our tensor-based recovery method can well capture the multi-dimensional spatial and temporal features by transforming the irregularly deployed sensors into a sensor-array and folding the periodic temporal patterns into multiple time dimensions, ii) it only requires to tune one key parameter in an unsupervised manner, and iii) Tensor Singular Value Decomposition structure is more efficient on representation of high-dimension sensor data than other tensor recovery methods based on tensor’s vectorization or flattening. The experimental results in several real-world one-year air quality and meteorology datasets demonstrate the effectiveness and accuracy of our approach.