This repository contains code for the paper, "Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks" by Zahra Atashgahi, Xuhao Zhang, Neil Kichler, Shiwei Liu, Lu Yin, Mykola Pechenizkiy, Raymond Veldhuis, Decebal Constantin Mocanu, which is accepted by TMLR (https://openreview.net/forum?id=GcO6ugrLKp).
K=50
seed=0
dataset=coil20 # USPS isolet har MNIST Fashion-MNIST BASEHOCK (batch size = 100) arcene Prostate_GE SMK GLA-BRA-180 (batch size = 20)
python3 ./code/main.py --dataset_name $dataset \
--model "NeuroFS" --K $K\
--batch_size 100 --lr 0.01 --epochs 100\
--zeta_in 0.2 --zeta_hid 0.3 --epsilon 30\
--num_hidden 1000 --seed $seed --wd 0.00001\
--gradient_addition --frac_epoch_remove 0.65 \
--activation "tanh"
Following Python packages have to be installed before executing the project code:
keras 2.3.1
keras-gpu 2.3.1
matplotlib 3.5.1
numpy 1.21.5
python 3.7.13
python-dateutil 2.8.2
scikit-learn 1.0.2
scipy 1.7.3
tensorflow 1.14.0
tensorflow-gpu 1.14.0
Starting of the code is the Sparse Evolutionary Training (SET) algorithm which is available at: https://github.com/dcmocanu/sparse-evolutionary-artificial-neural-networks
@article{
atashgahi2022supervised,
title={Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks},
author={Zahra Atashgahi and Xuhao Zhang and Neil Kichler and Shiwei Liu and Lu Yin and Mykola Pechenizkiy and Raymond Veldhuis and Decebal Constantin Mocanu},
journal={Transactions on Machine Learning Research},
issn={2835-8856},
year={2022},
url={https://openreview.net/forum?id=GcO6ugrLKp},
note={}
}
email: z.atashgahi@utwente.nl