Hand-Based Person Identification using Global and Part-Aware Deep Feature Representation Learning

Baisa, Nathanael L. and Jiang, Zheheng and Vyas, Ritesh and Williams, Bryan and Rahmani, Hossein and Angelov, Plamen and Black, Sue (2021) Hand-Based Person Identification using Global and Part-Aware Deep Feature Representation Learning. arXiv. ISSN 2331-8422

Text (2101.05260v1)
2101.05260v1.pdf - Published Version
Available under License Creative Commons Attribution-NonCommercial.
Download (831kB)

Abstract

In cases of serious crime, including sexual abuse, often the only available information with demonstrated potential for identification is images of the hands. Since this evidence is captured in uncontrolled situations, it is difficult to analyse. As global approaches to feature comparison are limited in this case, it is important to extend to consider local information. In this work, we propose hand-based person identification by learning both global and local deep feature representation. Our proposed method, Global and Part-Aware Network (GPA-Net), creates global and local branches on the conv-layer for learning robust discriminative global and part-level features. For learning the local (part-level) features, we perform uniform partitioning on the conv-layer in both horizontal and vertical directions. We retrieve the parts by conducting a soft partition without explicitly partitioning the images or requiring external cues such as pose estimation. We make extensive evaluations on two large multi-ethnic and publicly available hand datasets, demonstrating that our proposed method significantly outperforms competing approaches.