deephealthproject / eddl

European Distributed Deep Learning (EDDL) library. A general-purpose library initially developed to cover deep learning needs in healthcare use cases within the DeepHealth project.
https://deephealthproject.github.io/eddl/
MIT License
34 stars 10 forks source link

Different training results with Keras and EDDL #319

Open drodagu opened 2 years ago

drodagu commented 2 years ago

Hi, I have been doing some tests with a very simple model for regression: 3 dense layers 50 neurons each, 8 inputs and a single output. When I do inference with the same model using Keras and EDDL, the results obtained are different. I'm using EDDL v1.0.3b with CUDNN.

In all the test, the model was initialized in Keras and imported into the EDDL as an ONNX file. The blue dots are the inference results obtained with Keras, while the red dots are the inference results obtained with EDDL.

In the first test, the inference results of Keras were obtained with the model trained using Keras, while for the inference results in EDDL the model was trained in EDDL.

keras_eddl

In the second test, the model was trained with keras.

keras_trained_eddl

And in the last test, the model was trained with EDDL.

keras_eddl_trained

The Y axis correspond to the expected results (Test_Y) and the X axis correspond to the predicted results. In the three test, EDDL has trouble predicting values that are greater than 0.4.

The files used to perform the tests are these: inference_keras_eddl.zip