Uncertainty-aware Pedestrian Crossing Prediction via Reinforcement Learning

Dai, Siyang and Liu, Jun and Cheung, Ngai-Man (2024) Uncertainty-aware Pedestrian Crossing Prediction via Reinforcement Learning. IEEE Transactions on Circuits and Systems for Video Technology. ISSN 1051-8215

[thumbnail of Uncertainty-aware Pedestrian]
Text (Uncertainty-aware Pedestrian)
Uncertainty-aware_Pedestrian.pdf - Accepted Version

Download (813kB)

Abstract

Pedestrian safety is a huge concern for deploying autonomous vehicles in urban environments. Accidents involving pedestrians pose a higher degree of severity, sometimes causing serious injuries and fatalities [1]. It’s a challenging task to predict whether a pedestrian will cross the road since they can move in any direction and change motion suddenly. The inherent uncertainty in pedestrian motion has been addressed with probabilistic models in previous works. However, these models are too computationally expensive for real-time predictions. In this paper, we propose a novel reinforcement learning (RL) framework which produces soft labels for the training dataset in order to address the observed data uncertainty. We formulate novel state representations incorporating predictive uncertainty to learn more informative soft labels that improve the model performance and reliability. Finally, we validate the proof of concept with two benchmark datasets and show with extensive experiments on competitive prediction models that our method (even using fewer input modalities) significantly improves the accuracy and f1 score by up to 12% and 13% respectively. We also show that soft labeling as a form of regularization increases model reliability where the model is more accurate when the confidence level is high and more aware of its limitations with indication of low confidence.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Transactions on Circuits and Systems for Video Technology
Uncontrolled Keywords:
/dk/atira/pure/subjectarea/asjc/2200/2214
Subjects:
?? media technologyelectrical and electronic engineering ??
ID Code:
224204
Deposited By:
Deposited On:
25 Sep 2024 11:10
Refereed?:
Yes
Published?:
Published
Last Modified:
01 Oct 2024 00:59