search

FLAIR-THU / CreamFL

[ICLR 2023] Multimodal Federated Learning via Contrastive Representation Ensemble
https://arxiv.org/abs/2302.08888
84 stars 12 forks source link

Local performance #6

Open SilviaGrosso opened 11 months ago

SilviaGrosso commented 11 months ago

Did you try to enhance the performance on the local-side in your experiments?

I'm trying many different sets of lr, lr scheduler, optimizer, batch size with different data partitions.... nothing seams to increase the local metrics.

yqy2001 commented 11 months ago

Our work focused on the performance of the large server model and did not pay attention to the client performance.

How to improve edge performance is a worth-exploring research problem (similar to personalized FL). If the local metrics of our framework are hard to improve with hyperparameter tuning, it may be worthwhile to explore more advanced techniques targeting at enhancing local performance.

Thank you.