Adnan Siraj Rakin*, Yukui Luo*, Xiaolin Xu and Deliang Fan, “Deep-Dup: An Adversarial Weight Duplication Attack Framework to Crush Deep Neural Network in Multi-Tenant FPGA,” In 30th USENIX Security Symposium, August 11-13, 2021 (*first two authors contribute equally) https://www.usenix.org/conference/usenixsecurity21/presentation/rakin
The wide deployment of Deep Neural Networks (DNN) in high-performance cloud computing platforms brought to light field-programmable gate arrays (FPGA) as a popular choice of accelerator to boost performance due to its hardware reprogramming flexibility. To improve the efficiency of hardware resource utilization, growing efforts have been invested in FPGA virtualization, enabling the co-existence of multiple independent tenants in a shared FPGA chip. Such multi-tenant FPGA setup for DNN acceleration potentially exposes DNN interference task under severe threat from malicious users. This work, to the best of our knowledge, is the first to explore DNN model vulnerabilities in multi-tenant FPGAs. We propose a novel adversarial attack framework: Deep-DupA, in which the adversarial tenant can inject faults to the DNN model of victim tenant in FPGA. Specifically, she can aggressively overload the shared power distribution system of FPGA with malicious power-plundering circuits, achieving adversarial weight duplication (AWD) hardware attack that duplicates certain DNN weight packages during data transmission between off-chip memory and on-chip buffer, with the objective to hijack DNN function of the victim tenant. Further, to identify the most vulnerable DNN weight packages for a given malicious objective, we propose a generic vulnerable weight package searching algorithm, called Progressive Differential Evolution Search (P-DES), which is, for the first time, adaptive to both deep learning white-box and black-box attack models. Unlike prior works only working in a deep learning white-box setup, our adaptiveness mainly comes from the fact that the proposed P-DES does not require any gradient information of DNN model. The proposed Deep-DupA is validated in a developed multi-tenant FPGA prototype, for two popular deep learning applications, i.e., Object Detection and Image Classification. Successful attacks are demonstrated in six popular DNN architectures (e.g., YOLOv2, ResNet-50, MobileNet, etc.) on three datasets (COCO, CIFAR-10, and ImageNet). The experimental results demonstrate the effectiveness of the proposed Deep-DupA attack framework. For example, Deep-DupA can successfully attack MobileNetV2 (i.e., degrade test accuracy from 70 % to lower than 0.2 %), with only ~2 weight package duplication out of 2.1 Million on ImageNet dataset.
In the repository, we provide a sample code to implement Deep_DupA attack for CIFAR10 dataset. The paper can be find in https://www.usenix.org/conference/usenixsecurity21/presentation/rakin. The link to get the VGG-11 and Resnet-20 model is: https://drive.google.com/drive/folders/1sFJZc69hIRaHlR55VZnR1ccE5sTo7W9C?usp=sharing. Download the two models and keep them in the same folder Deep_Dup_A.
- VGG-11 targeted Attack python VGG_tar_final.py
or
- ResNet-20 targeted Attack python Res_tar_final.py
or
- ResNet-20 un-targeted Attack python res_un.py
or
- VGG-11 un-targeted Attack python vgg_uni.py
Please see the attack.sh file where each command can be found. To run all the attacks together command:
bash attack.sh
Attack.py contains the P-DES code. Any model can be used to attack using the attack module in attack.py. The code is general and works on any dataset or model.
--iteration = number of attack iteration
--z = number of evolution
--target = target attack class if targetd attack
--batch_size = test batch size
--probab = AWD success probability
--data = data path
run the follwing command to install the dependencies:
bash requirement.sh
@inproceedings {274646,
author = {Adnan Siraj Rakin and Yukui Luo and Xiaolin Xu and Deliang Fan},
title = {Deep-Dup: An Adversarial Weight Duplication Attack Framework to Crush Deep Neural Network in Multi-Tenant {FPGA}},
booktitle = {30th {USENIX} Security Symposium ({USENIX} Security 21)},
year = {2021},
isbn = {978-1-939133-24-3},
pages = {1919--1936},
url = {https://www.usenix.org/conference/usenixsecurity21/presentation/rakin},
publisher = {{USENIX} Association},
month = aug,}