FedExP

[jafermarq]

FedExP

• Title: FedExP: Speeding Up Federated Averaging via Extrapolation
• Venue: ICLR 2023
• Link to paper: https://openreview.net/forum?id=IPrzNbddXV

Do you want to work on this baseline?

🌻 Check everything about the Summer of Reproducibility on flower.dev/summer

All available baselines are listed in the Summer of Reproducibility Dashboard and also in the GitHub Issues with the summer-of-reproducibility label. The content is the same.

📝 It is advised to complete these steps before your start working on your code. But if you can't wait to implement your baseline with Flower (we totally understand it 😄), please ensure you follow the steps on how to contribute a new baseline.

What follows are the steps 1 & 2 in the Summer of Reproducibility instructions.

1. Join the Summer of Reproducibility program

• [x] Join the Flower Slack and say "hi! 👋" in the channel #summer-of-reproducibility.
• [x] Pick a baseline from our curated list <---------------------------------------- [you are doing this now]

  2. Define the scope of your contribution

• [x] What are you going to reproduce? Add a comment to your issue and tell us about your plan regarding this baseline: what experiments from the paper are you reproducing?, for which datasets ? the more details you provide us with the better !

• [x] Check if you are eligible for a reward.

  As we have to comply with US/EU regulations, we have checked that individual contributors based on these countries or territories are eligible: Australia, Austria, Belgium, Bulgaria, Canada, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Gibraltar, Greece, Hong Kong SAR China, Hungary, India, Ireland, Italy, Japan, Latvia, Liechtenstein, Lithuania, Luxembourg, Malta, Mexico, Netherlands, New Zealand, Norway, Poland, Portugal, Romania, Singapore, Slovakia, Slovenia, South Korea, Spain, Sweden, Switzerland, Thailand, United Arab emirates, United Kingdom United States.

  If where you are based is not on the list, please send us an email (summer@flower.dev) letting us know a bit about yourself (where are you currently based?, are you a university student? do you work at a public institution?). Please tell us the baselines you are interested in implementing (i.e. tell us your GitHub issue if you have crated one). We will reach back to you.

• [x] We will discuss with you about your contribution plan, if it sounds like a substantial enough contribution according to the Summer of Reproducibility rules (check our website flower.dev/summer), you'll get the OK from us to start working on your baseline!

What happens next?

• [x] This item will be moved to the In Progress stage by a member of the Flower Team.

• [ ] Follow the instructions for creating a new baseline which will guide you through the process step-by-step.

Is something wrong or not clear ?

• Ask a question directly in your issue.
• Reach out to us via the Flower Slack and ask your question in the #summer-of-reproducibility channel
• Check all the details (including FAQ) in the Summer of Reproducibility website: flower.dev/summer

[Roeia99]

Hi @jafermarq, I would like to implement the FedEXP technique in the Flower framework.

The experiments will involve comparing the performance of FedEXP against FedAvg as the baseline method, I will utilize the ResNet-18 model.

Also, I plan to reproduce the experiments proposed in the paper (Figure 3 and Table 1) using the CIFAR-10 and CIFAR-100 datasets.

Background: I am a fresh grad, I recently got my bachelor's degree in computer engineering. I am highly enthusiastic about delving into federated learning and privacy-preserving techniques. These areas of research align perfectly with my interests and academic background.

[jafermarq]

Hi @Roeia99, sorry for the massive delay getting back to you. I like the plan you propose. Just a couple of points before we proceed with this:

• could you please confirm that you are from one of the eligible countries/territories in the list above (see the second point in Step2). You don't need to tell me where you are based here. If you are not in one of those please see the paragraph below the list of countries and reach out to us by email.
• Are you confident that you'd have the time and access to resources (e.g. a couple of GPUs on your PC or your labs' servers -- I fear options like Colab might not be enough to replicate the experiments you proposed) to run FedExP. I'm asking this also in part because I don't see much activity on your GitHub profile ...

[Roeia99]

Hi @jafermarq Yes, I am based in one of the eligible countries listed above.

For the second point, Yes I have access to the necessary resources to run FedExP other than Colab.

[jafermarq]

Hi @Roeia99, thank you for the extra info. Then all looks good to me. I have now ✅ all points in Step 1 &2, added you as the assignee of this issue, and moved this baseline to In Progress status. You can find a detailed guide on how to start with the code by following the link in the What happens Next? section in the issue description above. You are very welcome to reach out to me and the other contributors via our Slack workspace if you encounter any problems or if you have suggestions on how to improve things. Please remember the Summer of Reproducibility runs until the end of September. You can find this info and more in our website: flower.dev/summer

Really looking forward to seeing your FedExP implementation in action!

[jafermarq]

Hi @Roeia99! This is just a gentle reminder that the Flower Summer of Reproducibility is ending at the end of the month. With just a little more than 3 weeks to go, we are excited to see quite a few baselines well ahead in the process with their respective PRs close to ready. If your PR is already on the list, great !! Please make sure the PR is linked to this issue (you just need to copy the URL of this issue somewhere in the main message of your PR). Ping me when you'd like me to take a look.

Also, make sure you keep an eye:eyes: on the #summer-of-reproducibility channel in the Flower Slack. I’ll announce very soon a new (the third!) round of 1:1 ask-me-anything sessions to help Summer of Reproducibility contributors like yourself to meet the deadline. Please consider booking a time slot if you want to chat with me about your baseline, potential issues you have making your code run, how to open a PR, doubts about what to include in your readme, how to use Hydra configs more effective, etc … all questions are welcome!!