Official repository for the paper Revisiting Context Aggregation for Image Matting
AEMatter is a simple yet powerful matting network.
无有入无间，吾是以知无为之有益。
Only nothing can enter into no-space. Hence, I know the advantages of non-doing.
GPU memory >= 10GB for inference on Adobe Composition-1K testing set.
- torch >= 1.10, < 2.0
- numpy >= 1.16
- opencv-python >= 4.0
- einops >= 0.3.2
- timm >= 0.4.12
The model can only be used and distributed for noncommercial purposes. It is recommended to use the RWA (Real World Augmentation) model for matting on real-world images.
Quantitative results on Adobe Composition-1K
| Model Name | Size | MSE | SAD | Grad | Conn |
|---|---|---|---|---|---|
| AEMatter | 195MiB | 2.26 | 17.53 | 4.76 | 12.46 |
| AEMatter+TTA | 195MiB | 2.06 | 16.89 | 4.24 | 11.72 |
| AEMatter (RWA) | 195MiB | - | - | - | - |
Quantitative results on Transparent-460
| Model Name | Size | MSE | SAD | Grad | Conn |
|---|---|---|---|---|---|
| AEMatter | 195MiB | 6.92 | 122.27 | 27.42 | 112.02 |
Quantitative results on AIM-500
| Model Name | Size | MSE | SAD | Grad | Conn |
|---|---|---|---|---|---|
| AEMatter | 195MiB | 11.69 | 14.76 | 11.20 | 14.20 |
Due to differences in data set preparation, the quantitative results on Distinction-646 and Semantic Image Matting are not shown.
We provide the script train.py for training. You should modify the dataset.py file to set the data paths. The training and testing code appears to have numerical instability issues when executed on GPUs with PyTorch 2.0. This problem can be alleviated by modifying the order of the norm layers in AEAL. We have provided a PyTorch 2.0 branch, but it has not been trained or evaluated.
We provide the script eval.py for evaluation.
@inproceedings{liu2024aematter,
title={Revisiting Context Aggregation for Image Matting},
author={Liu, Qinglin and Lv, Xiaoqian and Meng, Quanling and Li, Zonglin and Lan, Xiangyuan and Yang, Shuo and Zhang, Shengping and Nie, Liqiang},
booktitle ={International Conference on Machine Learning (ICML)},
year={2024},
}