adap / flower

Flower: A Friendly Federated AI Framework
https://flower.ai
Apache License 2.0
5.18k stars 885 forks source link

LeRobot example #4464

Open ivelin opened 3 weeks ago

ivelin commented 3 weeks ago

Describe what the documentation is missing.

Hello , Flower team! Congrats for the great progress with this awesome project. With the recent breakthrough in open source robotics AI models, it appears feasible to implement collaborative model training. Lack of sufficient data seems to continue to be the limiting factor for robotics AI. Flower may be able to help with that.

Suggest your improvement.

I wrote and tested locally a flower example based on the LeRobot Pusht task in a simulated gym environment. Here is the repo. If there is interest, I would be happy to create a pull request. Let me know. https://github.com/ivelin/zk0/tree/federate-pusht-gym/federate

https://github.com/user-attachments/assets/a9771310-e48d-4426-9cc5-850b2efabae3

jafermarq commented 12 hours ago

Hey @ivelin, sorry for the delay getting back to you on this topic -- it has been very busy weeks in Flower HQ 😆 !!

I just ran your example, looks pretty good and a great addition to the Flower Examples collection. I added this extra line to your pyproject.toml to include the LeRobot dependency and use the latest versions of flwr and flwr-datasets.

dependencies = [
    "flwr[simulation]==1.13.1",
    "lerobot[pusht] @ git+https://github.com/huggingface/lerobot.git@96c7052777aca85d4e55dfba8f81586103ba8f61",
    "flwr-datasets>=0.4.0",
    ...
    ]

Would you like to open a PR?