search

nnstreamer / nntrainer

NNtrainer is Software Framework for Training Neural Network Models on Devices.
Apache License 2.0
134 stars 71 forks source link

[Layer] Fix logic: SwiGLU Layer Training Incompatibility #2653

Closed djeong20 closed 5 days ago

djeong20 commented 6 days ago

Currently, the SwiGLU layer using OpenCL operations does not support training/backpropagation. Consequently, we are updating the logic to reflect that it is false.

Self-evaluation:

  1. Build test: [X]Passed [ ]Failed [ ]Skipped
  2. Run test: [X]Passed [ ]Failed [ ]Skipped
taos-ci commented 6 days ago

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #2653. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.