search

AI-secure / FLBenchmark-toolkit

Federated Learning Framework Benchmark (UniFed)
https://unifedbenchmark.github.io/
Apache License 2.0
47 stars 5 forks source link

how do you test lenet and mlp_128 in FedScope framework? #3

Open sinsauzero opened 1 year ago

sinsauzero commented 1 year ago

I read ur paper and notice that you give a benchmark result on feminist dataset. U give the model of LeNet and MLP_128 results on FedScope framework. I also check the source code of FederateScope and find there's no any implement of those two models. I notice that u give the config of LeNet on Feminist dataset. So I wonder how did u test those two models? Did u implement by hand or what?

sinsauzero commented 1 year ago

Moreover, I check FedScope and run the feminist dataset using mlp and lr, found the results are extremely different. Wonder if u can provide the original config of FedScope using these shallow layers. Thanks