Releases: sunshangquan/logit-standardization-KD
Releases · sunshangquan/logit-standardization-KD
teacher weights of wrn_28_2, wrn_16_4, and wrn_28_4 in Table 5
The zip file includes the teacher model weights of wrn_28_2 (75.55), wrn_16_4 (77.37), and wrn_28_4 (78.78) we reproduced and used for reproducing Table 5 of our paper (Table 11 and 12 of DKD paper).
Note that their results may fluctuate slightly (difference within 0.2) since DKD does not release their versions.
imagenet_model
python tools/eval.py -m ResNet18 -c output/imagenet_baselines/kd,res34,res18/kd.res34.res18.student -d imagenet
visualization_weights
The model weights for visualization in Figure 3, 4, and 5. Please find details in tools/visualizations/