Spatial and Channel Attention in CNN Architectures for Image Classification task

Author

Arpit Aggarwal

Introduction to the Project

In this project, different CNN Architectures like VGG-16, VGG-19, and ResNet-50, with and without CBAM module used for adding Spatial and Channel Attention to the feature maps, were used for the task of Dog-Cat image classification. The input to the CNN networks was a (224 x 224 x 3) image and the number of classes were 2, where '0' was for a cat and '1' was for a dog. The CNN architectures were implemented in PyTorch and the loss function was Cross Entropy Loss. The hyperparameters to be tuned were: Number of epochs(e), Learning Rate(lr), momentum(m), weight decay(wd) and batch size(bs).

Data

The data for the task of Dog-Cat image classification can be downloaded from: https://drive.google.com/drive/folders/1EdVqRCT1NSYT6Ge-SvAIu7R5i9Og2tiO?usp=sharing. The dataset has been divided into three sets: Training data, Validation data and Testing data. The analysis of different CNN architectures(with CBAM module and without) for Dog-Cat image classification was done on comparing the Training Accuracy and Validation Accuracy values.

Results

The results after using different CNN architectures are given below:

1. VGG-16(without CBAM, pre-trained on ImageNet dataset)
   

Training Accuracy = 99.27% and Validation Accuracy = 96.73% (e = 50, lr = 0.005, m = 0.9, bs = 32, wd = 0.001)

2. VGG-19(without CBAM, pre-trained on ImageNet dataset)
   

Training Accuracy = 99.13% and Validation Accuracy = 97.25% (e = 50, lr = 0.005, m = 0.9, bs = 32, wd = 5e-4)

3. ResNet-50(without CBAM, pre-trained on ImageNet dataset)
   

Training Accuracy = 99.43% and Validation Accuracy = 98.43% (e = 50, lr = 0.005, m = 0.9, bs = 32, wd = 5e-4)

4. VGG-16(with CBAM, pre-trained on ImageNet dataset)
   

Training Accuracy = 99.66% and Validation Accuracy = 98.21% (e = 30, lr = 1e-3, m = 0.9, bs = 32, wd = 5e-4)

5. VGG-19(with CBAM, pre-trained on ImageNet dataset)
   

Training Accuracy = 99.66% and Validation Accuracy = 98.95% (e = 30, lr = 1e-3, m = 0.9, bs = 32, wd = 0.001)

Software Required

To run the jupyter notebooks, use Python 3. Standard libraries like Numpy and PyTorch are used.

Credits

The following links were helpful for this project:

1. https://blog.paperspace.com/attention-mechanisms-in-computer-vision-cbam/
2. https://github.com/kobiso/CBAM-tensorflow