Official PyTorch implementation of "Loss-Curvature Matching for Dataset Selection and Condensation" (AISTATS 2023) by Seungjae Shin*, HeeSun Bae*, Donghyeok Shin, Weonyoung Joo, and Il-Chul Moon.
LCMat identifies the optimal dataset by matching the worst loss-curvature gap between the original dataset and the reduced dataset. It learns toward achieving the generalization around the local parameter region on dataset reduction procedure. Our implementation code is largely dependent on the code of DeepCore. We thank the authors for providing these codes.
Here,
By considering the sharpness on loss difference, LCMat(right) can successfully identify the reduced dataset
Please install required libraries as follows.
We kindly suggest other researchers to run this code on python = 3.8
version.
pip install -r requirements.txt
For reproduce the results of LCMAT-S, we provide a bash file for running main.py
, which located at:
/bash/LCMat_XXX.sh
Here, XXX is dataset. You can get results in result/
directory.
You can also reproduce cross-architecture generalization result by running cross_network_generalization.py
.
We will also release the code of LCMat-C soon.
Thank you for your Interest in our paper!