search

GoogleCloudPlatform / cloudml-samples

Cloud ML Engine repo. Please visit the new Vertex AI samples repo at https://github.com/GoogleCloudPlatform/vertex-ai-samples
https://cloud.google.com/ai-platform/docs/
Apache License 2.0
1.52k stars 855 forks source link

Missing regularization in flowers model #34

Closed EffePen closed 7 years ago

EffePen commented 7 years ago

This is not exactly an issue, more a missing feature: In the flowers model, the loss function only takes into account data loss and no regularization (such as L2 regularization) is possible except dropout. Currently I am retraining the model with my own dataset and it suffers from overfitting, therefore the addition of regularization might help. Is this choice due to ML considerations or the regularization has not been included just to keep the example simple and because the flowers-dataset didn't need it?

joshgc commented 7 years ago

Good point. We didn't introduce regularization for simplicity (it does OK on 3000 images in flowers/) and to keep consistency with the original Tensorflow code retrain.py.

I'd love to hear about which regularization you chose and how it performed. Could you run it against flowers too?

puneith commented 7 years ago

Closing this issue because of inactivity and that its not really an issue.