Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark

Wenke Huang, Mang Ye, Zekun Shi, Guancheng Wan, He Li, Bo Du, Qiang Yang Link IEEE TPAMI, 2024

By MARS Group at the Wuhan University, led by Prof. Mang Ye.

Abstract

Federated learning has emerged as a promising paradigm for privacy-preserving collaboration among different parties. Recently, with the popularity of federated learning, an influx of approaches have delivered towards different realistic challenges. In this survey, we provide a systematic overview of the important and recent developments of research on federated learning. Firstly, we introduce the study history and terminology definition of this area. Then, we comprehensively review three basic lines of research: generalization, robustness, and fairness, by introducing their respective background concepts, task settings, and main challenges. We also offer a detailed overview of representative literature on both methods and datasets. We further benchmark the reviewed methods on several well-known datasets. Finally, we point out several open issues in this field and suggest opportunities for further research. We also provide a public website to continuously track developments in this fast advancing field.

Our Works

• Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark
  • Abstract
  • Our Works
    • Federated Learning Survey
    • Heterogeneity Federated Learning
    • Robustness Federated Learning
  • Citation
  • Contact

Federated Learning Survey

• Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark TPAMI 2024

• Heterogeneous Federated Learning: State-of-the-art and Research Challenges ACM Computing Surveys 2023 [Code]

Heterogeneity Federated Learning

• FCCL+ — Generalizable Heterogeneous Federated Cross-Correlation and Instance Similarity Learning TPAMI 2023 [Code]

• FedAS — FedAS: Bridging Inconsistency in Personalized Federated Learning CVPR 2024 [Code]

• FPL — Rethinking Federated Learning with Domain Shift: A Prototype View CVPR 2023 [Code]

• FGSSL — Federated Graph Semantic and Structural Learning IJCAI 2023 [Code]

• FCCL — Learn from Others and Be Yourself in Heterogeneous Federated Learning CVPR 2022 [Code]

Robustness Federated Learning

• FDCR — Parameter Disparities Dissection for Backdoor Defense in Heterogeneous Federated Learning NeurIPS 2024 [Code]

• SDEA — Self-Driven Entropy Aggregation for Byzantine-Robust Heterogeneous Federated Learning ICML 2024 [Code]

• SDFC — Fisher Calibration for Backdoor-Robust Heterogeneous Federated Learning ECCV 2024 [Code]

• DynamicPFL — Dynamic Personalized Federated Learning with Adaptive Differential Privacy NeurIPS 2023 [Code]

• AugHFL — Robust Heterogeneous Federated Learning under Data Corruption ICCV 2023 [Code]

• RHFL — Robust Federated Learning With Noisy and Heterogeneous Clients CVPR 2022 [Code]

• FSMAFL — Few-Shot Model Agnostic Federated Learning ACMMM 2022 [Code]

Fairness Federated Learning

• FedHEAL — Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversity CVPR 2024 [Code]

Citation

Please kindly cite these papers in your publications if it helps your research:

@article{FLSurveyandBenchmarkforGenRobFair_TPAMI24,
    title={A Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark},
    author={Wenke Huang and Mang Ye and Zekun Shi and Guancheng Wan and He Li and Bo Du and Qiang Yang},
    journal={TPAMI},
    year={2024}
}
@inproceedings{FDCR_NeurIPS24,
    title    = {Parameter Disparities Dissection for Backdoor Defense in Heterogeneous Federated Learning},
    author    = {Huang, Wenke and Ye, Mang and Shi, Zekun and Wan, Guancheng and Du, Bo},
    booktitle = {NeurIPS},
    year      = {2024}
}
@inproceedings{SDEA_ICML24,
    title    = {Self-Driven Entropy Aggregation for Byzantine-Robust Heterogeneous Federated Learning},
    author    = {Wenke Huang and Zekun Shi and Mang Ye and He Li and Bo Du},
    booktitle = {ICML},
    year      = {2024}
}
@inproceedings{SDFC_ECCV24,
    title    = {Fisher Calibration for Backdoor-Robust Heterogeneous Federated Learning},
    author    = {Wenke Huang and Mang Ye and Zekun Shi and Bo Du and Dacheng, Tao},
    booktitle = {ECCV},
    year      = {2024}
}
@inproceedings{FedHEAL_CVPR2024,
    author    = {Chen, Yuhang and Huang, Wenke and Ye, Mang},
    title     = {Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversity},
    booktitle = {CVPR},
    year      = {2024}
}
@inproceedings{FedAS_CVPR24,
    author    = {Yang, Xiyuan and Huang, Wenke and Ye, Mang},
    title     = {FedAS: Bridging Inconsistency in Personalized Fedearated Learning},
    booktitle = {CVPR},
    year      = {2024}
}
@article{FCCLPlus_TPAMI23,
    title={Generalizable Heterogeneous Federated Cross-Correlation and Instance Similarity Learning}, 
    author={Wenke Huang and Mang Ye and Zekun Shi and Bo Du},
    year={2023},
    journal={TPAMI}
}
@article{RUCR_TIFS24,
    title={Federated Learning with Long-Tailed Data via Representation Unification and Classifier Rectification},
    author={Wenke Huang and Yuxia Liu and Mang Ye and Jun Chen and Bo Du},
    booktitle={TIFS},
    year={2024},
}
@article{AbrFun_SCIS2024,
    author    = {Mang Ye and Wenke Huang and  Zekun Shi and He Li and Du Bo},
    title     = {Revisiting Federated Learning with Label Skew: An Over-Confidence Perspective},
    journal = {SCIS},
    year      = {2024}
}
@article{HFL_CSUR23,
  title={Heterogeneous Federated Learning: State-of-the-art and Research Challenges},
  author={Ye, Mang and Fang, Xiuwen and Du, Bo and Yuen, Pong C and Tao, Dacheng},
  journal={CSUR},
  year={2023}
}
@inproceedings{DynamicPFL_NeurIPS23,
    title={Dynamic Personalized Federated Learning with Adaptive Differential Privacy},
    author={Yang, Xiyuan and Huang, Wenke and Ye, Mang},
    booktitle={NeurIPS},
    year={2023},
}
@inproceedings{FPL_CVPR23,
    title={Rethinking Federated Learning with Domain Shift: A Prototype View},
    author={Huang, Wenke and Ye, Mang and Shi, Zekun and Li, He and Du, Bo},
    booktitle={CVPR},
    year={2023}
}

@inproceedings{FGSSL_IJCAI23,
    title={Federated Graph Semantic and Structural Learning},
    author={Huang, Wenke and Wan, Guancheng and Ye, Mang and Du, Bo},
    booktitle={IJCAI},
    year={2023}
}
@inproceedings{AugHFL_ICCV23,
  title={Robust heterogeneous federated learning under data corruption},
  author={Fang, Xiuwen and Ye, Mang and Yang, Xiyuan},
  booktitle={ICCV},
  pages={5020--5030},
  year={2023}
}
@inproceedings{FCCL_CVPR22,
    title={Learn from others and be yourself in heterogeneous federated learning},
    author={Huang, Wenke and Ye, Mang and Du, Bo},
    booktitle={CVPR},
    year={2022}
}
@inproceedings{FSMAFL_ACMMM22,
  title={Few-Shot Model Agnostic Federated Learning},
  author={Huang, Wenke and Ye, Mang and Du, Bo and Gao, Xiang},
  booktitle={ACMMM},
  pages={7309--7316},
  year={2022}
}
@inproceedings{RHFL_CVPR22,
    title={Robust Federated Learning with Noisy and Heterogeneous Clients},
    author={Fang, Xiuwen and Ye, Mang},
    booktitle={CVPR},
    year={2022}
}

Contact

This repository is currently maintained by Wenke Huang.

I hope all players have fun.