Improving adversarial robustness by a coupling rejection strategy

Last update: Jan 06, 2023

Related tags

Deep Learning Rectified-Rejection

Overview

Adversarial Training with Rectified Rejection

The code for the paper Adversarial Training with Rectified Rejection.

Environment settings and libraries we used in our experiments

This project is tested under the following environment settings:

OS: Ubuntu 18.04.4
GPU: Geforce 2080 Ti or Tesla P100
Cuda: 10.1, Cudnn: v7.6
Python: 3.6
PyTorch: >= 1.6.0
Torchvision: >= 0.6.0

Acknowledgement

The codes are modifed based on Rice et al. 2020, and the model architectures are implemented by pytorch-cifar.

Training Commands

Below we provide running commands training the models with the RR module, taking the setting of PGD-AT + RR (ResNet-18) as an example:

python train_cifar.py --model_name PreActResNet18_twobranch_DenseV1 --attack pgd --lr-schedule piecewise \
                                              --epochs 110 --epsilon 8 \
                                              --attack-iters 10 --pgd-alpha 2 \
                                              --fname auto \
                                              --batch-size 128 \
                                              --adaptivetrain --adaptivetrainlambda 1.0 \
                                              --weight_decay 5e-4 \
                                              --twobranch --useBN \
                                              --selfreweightCalibrate \
                                              --dataset 'CIFAR-10' \
                                              --ATframework 'PGDAT' \
                                              --SGconfidenceW

The FLAG --model_name can be PreActResNet18_twobranch_DenseV1 (ResNet-18) or WideResNet_twobranch_DenseV1 (WRN-34-10). For alternating different AT frameworks, we can set the FLAG --ATframework to be one of PGDAT, TRADES, CCAT.

Evaluation Commands

Below we provide running commands for evaluations.

Evaluating under the PGD attacks

The trained model is saved at trained_models/model_path, where the specific name of model_path is automatically generated during training. The command for evaluating under PGD attacks is:

python eval_cifar.py --model_name PreActResNet18_twobranch_DenseV1 --evalset test --norm l_inf --epsilon 8 \
                                              --attack-iters 1000 --pgd-alpha 2 \
                                              --fname trained_models/model_path \
                                              --load_epoch -1 \
                                              --dataset 'CIFAR-10' \
                                              --twobranch --useBN \
                                              --selfreweightCalibrate

Evaluating under the adaptive CW attacks

The parameter FLAGs --binary_search_steps, --CW_iter, --CW_confidence can be changed, where --detectmetric indicates the rejector that needs to be adaptively evaded.

python eval_cifar_CW.py --model_name PreActResNet18_twobranch_DenseV1 --evalset adaptiveCWtest \
                                              --fname trained_models/model_path \
                                              --load_epoch -1 --seed 2020 \
                                              --binary_search_steps 9 --CW_iter 100 --CW_confidence 0 \
                                              --threatmodel linf --reportmodel linf \
                                              --twobranch --useBN \
                                              --selfreweightCalibrate \
                                              --detectmetric 'RR' \
                                              --dataset 'CIFAR-10'

Evaluating under multi-target and GAMA attacks

The running command for evaluating under multi-target attacks is activated by the FLAG --evalonMultitarget as:

python eval_cifar.py --model_name PreActResNet18_twobranch_DenseV1 --evalset test --norm l_inf --epsilon 8 \
                                              --attack-iters 100 --pgd-alpha 2 \
                                              --fname trained_models/model_path \
                                              --load_epoch -1 \
                                              --dataset 'CIFAR-10' \
                                              --twobranch --useBN \
                                              --selfreweightCalibrate \
                                              --evalonMultitarget --restarts 1

The running command for evaluating under GAMA attacks is activated by the FLAG --evalonGAMA_PGD or --evalonGAMA_FW as:

python eval_cifar.py --model_name PreActResNet18_twobranch_DenseV1 --evalset test --norm l_inf --epsilon 8 \
                                              --attack-iters 100 --pgd-alpha 2 \
                                              --fname trained_models/model_path \
                                              --load_epoch -1 \
                                              --dataset 'CIFAR-10' \
                                              --twobranch --useBN \
                                              --selfreweightCalibrate \
                                              --evalonGAMA_FW

Evaluating under CIFAR-10-C

The running command for evaluating on common corruptions in CIFAR-10-C is:

python eval_cifar_CIFAR10-C.py --model_name PreActResNet18_twobranch_DenseV1 \
                                              --fname trained_models/model_path \
                                              --load_epoch -1 \
                                              --dataset 'CIFAR-10' \
                                              --twobranch --useBN \
                                              --selfreweightCalibrate

Improving adversarial robustness by a coupling rejection strategy

Related tags

Overview

Adversarial Training with Rectified Rejection

Environment settings and libraries we used in our experiments

Acknowledgement

Training Commands

Evaluation Commands

Evaluating under the PGD attacks

Evaluating under the adaptive CW attacks

Evaluating under multi-target and GAMA attacks

Evaluating under CIFAR-10-C

Owner

Tianyu Pang

This is an official source code for implementation on Extensive Deep Temporal Point Process

一个目标检测的通用框架(不需要cuda编译)，支持Yolo全系列(v2~v5)、EfficientDet、RetinaNet、Cascade-RCNN等SOTA网络。

The official PyTorch implementation of recent paper - SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training

Devkit for 3D -- Some utils for 3D object detection based on Numpy and Pytorch

Collection of NLP model explanations and accompanying analysis tools

PointCloud Annotation Tools, support to label object bound box, ground, lane and kerb

Self-Supervised Learning with Kernel Dependence Maximization

This is an official implementation for "PlaneRecNet".

MARS: Learning Modality-Agnostic Representation for Scalable Cross-media Retrieva

Pytorch implementation of COIN, a framework for compression with implicit neural representations 🌸

Pytorch re-implementation of Paper: SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition (CVPR 2022)

School of Artificial Intelligence at the Nanjing University (NJU)School of Artificial Intelligence at the Nanjing University (NJU)

The implementation for "Comprehensive Knowledge Distillation with Causal Intervention".

The 2nd place solution of 2021 google landmark retrieval on kaggle.

Pose estimation with MoveNet Lightning

🗣️ Microsoft Edge TTS for Home Assistant, no need for app_key

2021搜狐校园文本匹配算法大赛分比我们低的都是帅哥队

TumorInsight is a Brain Tumor Detection and Classification model built using RESNET50 architecture.

PyTea: PyTorch Tensor shape error analyzer

A general framework for deep learning experiments under PyTorch based on pytorch-lightning

Improving adversarial robustness by a coupling rejection strategy

Related tags

Overview

Adversarial Training with Rectified Rejection

Environment settings and libraries we used in our experiments

Acknowledgement

Training Commands

Evaluation Commands

Evaluating under the PGD attacks

Evaluating under the adaptive CW attacks

Evaluating under multi-target and GAMA attacks

Evaluating under CIFAR-10-C

Owner

Tianyu Pang

This is an official source code for implementation on Extensive Deep Temporal Point Process

一个目标检测的通用框架(不需要cuda编译)，支持Yolo全系列(v2~v5)、EfficientDet、RetinaNet、Cascade-RCNN等SOTA网络。

The official PyTorch implementation of recent paper - SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training

Devkit for 3D -- Some utils for 3D object detection based on Numpy and Pytorch

Collection of NLP model explanations and accompanying analysis tools

PointCloud Annotation Tools, support to label object bound box, ground, lane and kerb

Self-Supervised Learning with Kernel Dependence Maximization

This is an official implementation for "PlaneRecNet".

MARS: Learning Modality-Agnostic Representation for Scalable Cross-media Retrieva

Pytorch implementation of COIN, a framework for compression with implicit neural representations 🌸

Pytorch re-implementation of Paper: SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition (CVPR 2022)

School of Artificial Intelligence at the Nanjing University (NJU)School of Artificial Intelligence at the Nanjing University (NJU)

The implementation for "Comprehensive Knowledge Distillation with Causal Intervention".

The 2nd place solution of 2021 google landmark retrieval on kaggle.

Pose estimation with MoveNet Lightning

🗣️ Microsoft Edge TTS for Home Assistant, no need for app_key

2021搜狐校园文本匹配算法大赛 分比我们低的都是帅哥队

TumorInsight is a Brain Tumor Detection and Classification model built using RESNET50 architecture.

PyTea: PyTorch Tensor shape error analyzer

A general framework for deep learning experiments under PyTorch based on pytorch-lightning

2021搜狐校园文本匹配算法大赛分比我们低的都是帅哥队