alibaba / FederatedScope

An easy-to-use federated learning platform
https://www.federatedscope.io
Apache License 2.0
1.32k stars 212 forks source link

Some questions about Backdoor Bench #756

Open tntstation opened 9 months ago

tntstation commented 9 months ago

hello! Recently,I found some issues when trying to reproduce the experiment in Revisiting Personalized Federated Learning: Robustness Against Backdoor Attacks. The output is a complex number result, and the evaluator assesses the test_acc and poison_acc for each client. However, in the paper's charts, it appears that only one model was evaluated. Did you select specific clients or perform some kind of processing? Thanks

yxdyc commented 9 months ago

@Alan-Qin zeyu, you can have a look when you are available.

Alan-Qin commented 9 months ago

Hi, In our paper and experiments, we take the evaluation on all client and compute the average value of all client's clean acc and poisoning acc.

Could you please show all details about your issues?

Bests, Zeyu