FedML-AI / FedNLP

FedNLP: An Industry and Research Integrated Platform for Federated Learning in Natural Language Processing, Backed by FedML, Inc. The Previous Research Version is Accepted to NAACL 2022
223 stars 45 forks source link

Could you support knowledge distillation-based FL algorithms like FedED, Fedmd, or FedDF #26

Open Barry-Menglong-Yao opened 2 years ago

Barry-Menglong-Yao commented 2 years ago

Currently, your platform supports some parameter-average-based FL algorithms. Could you support knowledge-distillation-based FL algorithms like FedED, Fedmd, or FedDF?

FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction, Fedmd: Heterogenous federated learning via model distillation. NeurIPS workshop, 2019 FedDF, Ensemble distillation for robust model fusion in federated learning. NeurIPS, 2020