search

nnstreamer / nntrainer

NNtrainer is Software Framework for Training Neural Network Models on Devices.
Apache License 2.0
144 stars 73 forks source link

[Wait for #2591] [ TEST ] Add more unittest and fixes for mixed precision #2607

Open jijoongmoon opened 4 months ago

jijoongmoon commented 4 months ago

In this PR

This PR includes more unittest and fixes for mixed precision. . Model Unittest . 2 fc layer which generates NaN or Inf Gradient from Troch. . MSE Loss and Check the whole procedure of the mixed precision training. . Even if the FC model only has one weight, it is good enough to validate the mixed precision. . Torch model also works similar way to NNTrainer. . Some fixes about the execution order of applying gradient when the mixed precision is on. . Update SGD to support Mixed Precision training

Changes proposed in this PR:

Resolves:

Self evaluation:

  1. Build test: [X]Passed [ ]Failed [ ]Skipped
  2. Run test: [X]Passed [ ]Failed [ ]Skipped

Signed-off-by: jijoong.moon jijoong.moon@samsung.com

taos-ci commented 4 months ago

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #2607. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.

taos-ci commented 4 months ago

:octocat: cibot: @jijoongmoon, nntrainer/graph/network_graph.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md

taos-ci commented 4 months ago

:octocat: cibot: @jijoongmoon, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2607-202405241023570.74135208129883-8828094a609da55fa2d1290ce358586c0dc29a1e/.

taos-ci commented 4 months ago

:octocat: cibot: @jijoongmoon, nntrainer/graph/network_graph.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md

taos-ci commented 4 months ago

:octocat: cibot: @jijoongmoon, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2607-202405241631370.59153199195862-76517f9897e6dbcc4b5bb5d1a6fa4e1826a7010d/.

taos-ci commented 4 months ago

:octocat: cibot: @jijoongmoon, nntrainer/graph/network_graph.cpp does not include Doxygen tags such as @file @brief @author @bug. You must include the Doxygen tags in the source code. Please refer to a Doxygen manual at http://github.com/nnstreamer/TAOS-CI/blob/main/ci/doc/doxygen-documentation.md

taos-ci commented 4 months ago

:octocat: cibot: @jijoongmoon, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2607-202405241817480.69026207923889-fd2ad3431228a0b8faacc2095fec7e20c6a88187/.