SymbioticLab / FedScale

FedScale is a scalable and extensible open-source federated learning (FL) platform.
https://fedscale.ai
Apache License 2.0
388 stars 119 forks source link

[FedScale Sim] Scalable data loading #203

Open fanlai0990 opened 1 year ago

fanlai0990 commented 1 year ago

Description

Each worker loads its unique partition of data into memory, allowing it to handle larger datasets. Aggregator knows which clients each worker handles based on hash mapping

Use case

No response