keras-team / tf-keras

The TensorFlow-specific implementation of the Keras API, which was the default Keras from 2019 to 2023.
Apache License 2.0
63 stars 28 forks source link

Possibility to use dropout in vgg16/19 #602

Closed zaccharieramzi closed 2 years ago

zaccharieramzi commented 2 years ago

If you open a GitHub issue, here is our policy:

It must be a bug, a feature request, or a significant problem with the documentation (for small docs fixes please send a PR instead). The form below must be filled out.

Here's why we have that policy:.

Keras developers respond to issues. We want to focus on work that benefits the whole community, e.g., fixing bugs and adding features. Support only helps individuals. GitHub also notifies thousands of people when issues are filed. We want them to see you communicating an interesting problem, rather than being redirected to Stack Overflow.

System information.

TensorFlow version (you are using): 2.8 Are you willing to contribute it (Yes/No) : Yes

Describe the feature and the current behavior/state.

I would like to be able to use dropout on the first two fully connected layers of the VGG implementations in keras applications, as specified in the original paper (and done in PyTorch).

dropout regularisation for the first two fully-connected layers (dropout ratio set to 0.5)

Will this change the current api? How?

Yes: this will mean adding a dropout kwarg to the VGG implementations, that will default to 0.0 to remain a non-breaking change.

Who will benefit from this feature?

Users willing to reproduce the original results of the VGG paper.

Contributing

qlzh727 commented 2 years ago

Ack, just as reference, the original paper stated that

"The training was regularised by weight decay (the L2 penalty multiplier set to 5 · 10−4) and dropout regularisation for the first two fully-connected layers (dropout ratio set to 0.5)."

https://arxiv.org/pdf/1409.1556.pdf

qlzh727 commented 2 years ago

Feel free to send any PR if you would like to contribute. Thanks

zaccharieramzi commented 2 years ago

Closing as per this.

google-ml-butler[bot] commented 2 years ago

Are you satisfied with the resolution of your issue? Yes No