LabeliaLabs / distributed-learning-contributivity

Simulate collaborative ML scenarios, experiment multi-partner learning approaches and measure respective contributions of different datasets to model performance.
https://www.labelia.org
Apache License 2.0
56 stars 12 forks source link

Change Cifar10's model optimizer #283

Closed arthurPignet closed 3 years ago

arthurPignet commented 3 years ago

The RMSprop optimizer can be changed to adam with a different learning rate. It greatly improves the training performance, as shown below.

image image image

However, even if I tried a few learning rates and decay values, these are propably not the perfect hyperparameters, do not hesitate to suggest another setup.

Signed-off-by: arthurPignet arthur.pignet@mines-paristech.fr