This is the official project repository for Fighting Gradients with Gradients: Dynamic Defenses against Adversarial Attacks by Dequan Wang, An Ju, Evan Shelhamer, David Wagner, and Trevor Darrell.
Adversarial attacks optimize against models to defeat defenses. We argue that models should fight back, and optimize their defenses against attacks at test-time. Existing defenses are static, and stay the same once trained, even while attacks change. We propose a dynamic defense, defensive entropy minimization (dent), to adapt the model and input during testing by gradient optimization. Our dynamic defense adapts fully at test-time, without altering training, which makes it compatible with existing models and standard defenses. Dent improves robustness to attack by 20+ points (absolute) for state-of-the-art static defenses against AutoAttack on CIFAR-10 at epsilon (L_infinity) = 8/255.
This example compares state-of-the-art adversarial training defenses, which are static, with and without our method for defense entropy minimization (dent), which is dynamic. We evaluate against white-box and black-box attacks and report the worst-case accuracy across attack types.
- Attacks: Standard AutoAttack, including untargeted APGD-CE (no restarts), targeted APGD-DLR (9 target classes), targeted FAB (9 target classes), black-box Square (5000 queries).
- Static Defenses: RobustBench Model Zoo, including Wu2020Adversarial_extra, Carmon2019Unlabeled, Sehwag2020Hydra, Wang2020Improving, Hendrycks2019Using, Wong2020Fast, Ding2020MMA.
- Dent: For this example, dent updates by test-time model adaptation, with sample-wise modulation of the parameters, but without input adaptation. Please see the paper for variants of model adaptation and input adaptation.
Result:
Dent improves adversarial/robust accuracy (%) by more than 30 percent (relative) against AutoAttack on CIFAR-10 while preserving natural/clean accuracy. Our dynamic defense brings adversarial accuracy within 90% of natural accuracy for the three most accurate methods tested (Wu 2020, Carmon 2019, Sehwag 2020). The static defenses alter training, while dent alters testing, and so this separation of concerns makes dent compatible with many existing models and defenses.
| Model ID | Paper | Natural (static) | Natural (dent) | Adversarial (static) | Adversarial (dent) | Venue |
|---|---|---|---|---|---|---|
| Wu2020Adversarial_extra | Adversarial Weight Perturbation Helps Robust Generalization | 88.25 | 87.65 | 60.04 | 80.33 | NeurIPS 2020 |
| Carmon2019Unlabeled | Unlabeled Data Improves Adversarial Robustness | 89.69 | 89.32 | 59.53 | 82.28 | NeurIPS 2019 |
| Sehwag2020Hydra | HYDRA: Pruning Adversarially Robust Neural Networks | 88.98 | 88.60 | 57.14 | 78.09 | NeurIPS 2020 |
| Wang2020Improving | Improving Adversarial Robustness Requires Revisiting Misclassified Examples | 87.50 | 86.32 | 56.29 | 77.31 | ICLR 2020 |
| Hendrycks2019Using | Using Pre-Training Can Improve Model Robustness and Uncertainty | 87.11 | 87.04 | 54.92 | 79.62 | ICML 2019 |
| Wong2020Fast | Fast is better than free: Revisiting adversarial training | 83.34 | 82.34 | 43.21 | 71.82 | ICLR 2020 |
| Ding2020MMA | MMA Training: Direct Input Space Margin Maximization through Adversarial Training | 84.36 | 84.68 | 41.44 | 64.35 | ICLR 2020 |
Usage:
python cifar10a.py --cfg cfgs/dent.yaml MODEL.ARCH Wu2020Adversarial_extra
python cifar10a.py --cfg cfgs/dent.yaml MODEL.ARCH Carmon2019Unlabeled
python cifar10a.py --cfg cfgs/dent.yaml MODEL.ARCH Sehwag2020Hydra
python cifar10a.py --cfg cfgs/dent.yaml MODEL.ARCH Wang2020Improving
python cifar10a.py --cfg cfgs/dent.yaml MODEL.ARCH Hendrycks2019Using
python cifar10a.py --cfg cfgs/dent.yaml MODEL.ARCH Wong2020Fast
python cifar10a.py --cfg cfgs/dent.yaml MODEL.ARCH Ding2020MMAPlease contact Dequan Wang, An Ju, and Evan Shelhamer at dqwang AT eecs.berkeley.edu, an_ju AT berkeley.edu, and shelhamer AT deepmind.com.
If the dent method or dynamic defense setting are helpful in your research, please consider citing our paper:
@article{wang2021fighting,
title={Fighting Gradients with Gradients: Dynamic Defenses against Adversarial Attacks},
author={Wang, Dequan and Ju, An and Shelhamer, Evan and Wagner, David and Darrell, Trevor},
journal={arXiv preprint arXiv:2105.08714},
year={2021}
}Note: a workshop edition of this project was presented at the ICLR'21 Workshop on Security and Safety in Machine Learning Systems.