search

joaopauloschuler / neural-api

CAI NEURAL API - Pascal based deep learning neural network API optimized for AVX, AVX2 and AVX512 instruction sets plus OpenCL capable devices including AMD, Intel and NVIDIA.
GNU Lesser General Public License v2.1
371 stars 199 forks source link

Learning Rate Decay #1

Closed joaopauloschuler closed 5 years ago

joaopauloschuler commented 5 years ago

Most APIs have the LR decay expressed with 0.01 or 0.001 as examples. It's required to change CAI to conform with this.

As an example from the problem look at this example: https://github.com/joaopauloschuler/neural-api/tree/master/examples/SimpleImageClassifier

This is the current LR setting: NeuralFit.LearningRateDecay := 0.995;

The requirement is to change API and examples to: NeuralFit.LearningRateDecay := 0.005;

joaopauloschuler commented 5 years ago

Done.