FedML-AI / FedML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
https://TensorOpera.ai
Apache License 2.0
4.17k stars 784 forks source link

I can't find the Fedadagrad, FedYogi, FedAdam algorithms #138

Open GzLee666 opened 3 years ago

GzLee666 commented 3 years ago

Hello, I have a question.Do you implement the Fedadagrad, FedYogi, FedAdam algorithm of the paper "Adaptive Federated Optimization" in the code fedopt?

fedml-dimitris commented 1 year ago

The general FedOpt Algorithm can be found here: https://github.com/FedML-AI/FedML/blob/master/python/fedml/simulation/mpi/fedopt_seq/FedOptAggregator.py#L235