LabeliaLabs / distributed-learning-contributivity

Simulate collaborative ML scenarios, experiment multi-partner learning approaches and measure respective contributions of different datasets to model performance.
https://www.labelia.org
Apache License 2.0
56 stars 12 forks source link

Add multiclass performance metrics in results #330

Open jeromechambost opened 3 years ago

jeromechambost commented 3 years ago

Until now, we have been saving only the global accuracy and loss of the models.

As the multipartner learning scenarios are getting more complex, it would be interesting to evaluate the performance of the federated models per class, for example by saving the confusion matrix in the results.