search

KarhouTam / FL-bench

Benchmark of federated learning. Dedicated to the community. 🤗
MIT License
472 stars 73 forks source link

A question about parallel mode when using pFedHN #90

Closed hmaster6 closed 1 hour ago

hmaster6 commented 2 hours ago

I encountered an error while using the pFedHN algorithm: parallel computing is not supported. I want to know if I have a way to use parallel computing by changing the configuration.Thank you! By the way, the word 'parallel' below seems to be misspelled. 屏幕截图 2024-09-20 101401

KarhouTam commented 2 hours ago

I set that error. pFedHN is incompatible with parallel training due to the hypernetwork. pFedHN needs the hypernetwork to generate model parameters. So pFedHN needs to update its hypernetwork right before the next client's training.

BTW, thanks for pointing out the typo. It will be fixed in no time.

KarhouTam commented 2 hours ago

Maybe you can change the update way of hypernetwork to aggregate gradients from more than 1 clients like FedAvg does. That can make pFedHN training parallelized, but the results is not guaranteed.

hmaster6 commented 1 hour ago

Thank you for your response, and I will try this.^_^