GradMDM : Adversarial Attack on Dynamic Networks

Pan, Jianhong and Foo, Lin Geng and Zheng, Qichen and Fan, Zhipeng and Rahmani, Hossein and Ke, Qiuhong and Liu, Jun (2023) GradMDM : Adversarial Attack on Dynamic Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45 (9). pp. 11374-11381. ISSN 0162-8828

Text (Layer_wise_Attack)
Layer_wise_Attack.pdf - Accepted Version
Available under License Creative Commons Attribution.
Download (881kB)

Abstract

Dynamic neural networks can greatly reduce computation redundancy without compromising accuracy by adapting their structures based on the input. In this paper, we explore the robustness of dynamic neural networks against \textit{energy-oriented attacks} targeted at reducing their efficiency. Specifically, we attack dynamic models with our novel algorithm GradMDM. GradMDM is a technique that adjusts the direction and the magnitude of the gradients to effectively find a small perturbation for each input, that will activate more computational units of dynamic models during inference. We evaluate GradMDM on multiple datasets and dynamic models, where it outperforms previous energy-oriented attack techniques, significantly increasing computation complexity while reducing the perceptibility of the perturbations.