ConvXformer: Differentially Private Hybrid ConvNeXt-Transformer for Inertial Navigation

Tariq, Omer and Bilal, Muhammad and Hassan, Muneeb Ul and Han, Dongsoo and Crowcroft, Jon (2025) ConvXformer: Differentially Private Hybrid ConvNeXt-Transformer for Inertial Navigation. Other. Arxiv.

Full text not available from this repository.

Abstract

Data-driven inertial sequence learning has revolutionized navigation in GPS-denied environments, offering superior odometric resolution compared to traditional Bayesian methods. However, deep learning-based inertial tracking systems remain vulnerable to privacy breaches that can expose sensitive training data. \hl{Existing differential privacy solutions often compromise model performance by introducing excessive noise, particularly in high-frequency inertial measurements.} In this article, we propose ConvXformer, a hybrid architecture that fuses ConvNeXt blocks with Transformer encoders in a hierarchical structure for robust inertial navigation. We propose an efficient differential privacy mechanism incorporating adaptive gradient clipping and gradient-aligned noise injection (GANI) to protect sensitive information while ensuring model performance. Our framework leverages truncated singular value decomposition for gradient processing, enabling precise control over the privacy-utility trade-off. Comprehensive performance evaluations on benchmark datasets (OxIOD, RIDI, RoNIN) demonstrate that ConvXformer surpasses state-of-the-art methods, achieving more than 40% improvement in positioning accuracy while ensuring (ϵ, δ)-differential privacy guarantees. To validate real-world performance, we introduce the Mech-IO dataset, collected from the mechanical engineering building at KAIST, where intense magnetic fields from industrial equipment induce significant sensor perturbations. This demonstrated robustness under severe environmental distortions makes our framework well-suited for secure and intelligent navigation in cyber-physical systems.

Item Type:
Monograph (Other)
Additional Information:
@ARTICLE{2025arXiv251019352T, author = {{Tariq}, Omer and {Bilal}, Muhammad and {Hassan}, Muneeb Ul and {Han}, Dongsoo and {Crowcroft}, Jon}, title = "{ConvXformer: Differentially Private Hybrid ConvNeXt-Transformer for Inertial Navigation}", journal = {arXiv e-prints}, keywords = {Machine Learning, Cryptography and Security, Robotics, 68T07, 68T05, 68P27, 62M10, I.2.6; I.5.1; I.2.9; K.4.1; K.6.5; C.3; G.3}, year = 2025, month = oct, eid = {arXiv:2510.19352}, pages = {arXiv:2510.19352}, doi = {10.48550/arXiv.2510.19352}, archivePrefix = {arXiv}, eprint = {2510.19352}, primaryClass = {stat.ML}, adsurl = {https://ui.adsabs.harvard.edu/abs/2025arXiv251019352T}, adsnote = {Provided by the SAO/NASA Astrophysics Data System} }
Uncontrolled Keywords:
Research Output Funding/yes_externally_funded
Subjects:
?? yes - externally fundedno ??
ID Code:
233255
Deposited By:
Deposited On:
31 Oct 2025 15:35
Refereed?:
No
Published?:
Published
Last Modified:
06 Dec 2025 21:20