This repo uses PyTorch's native distributed module in an implementation of federated learning.
It comes with a few experimental setups; various Residual Networks on CIFAR10, CIFAR100, FEMNIST, ImageNet (cv_train.py
) and GPT2 on PersonaChat (gpt2_train.py
).
There are a variety of command-line args which are best examined by looking at utils.py
The server is contained in fed_aggregator.py
and the worker is contained in fed_worker.py
Other relevant branches: attacks
contains an implementation of a malicious model poisoning adversary.
To use sketching, you need to install https://github.com/nikitaivkin/csh