search

nnstreamer / nntrainer

NNtrainer is Software Framework for Training Neural Network Models on Devices.
Apache License 2.0
135 stars 71 forks source link

[Wait for #2536][application] add generate_multiple_tokens for llm @open sesame 04/05 16:14 #2540

Closed baek2sm closed 2 months ago

baek2sm commented 3 months ago

Added generate_multiple_tokens function for first generation on llm.

This function takes one logits and generates multiple output tokens. To meet the purpose of the target application, even if input are multiple logits, only the first logits is used to generate multiple output tokens.

Self evaluation:

  1. Build test: [X]Passed [ ]Failed [ ]Skipped
  2. Run test: [X]Passed [ ]Failed [ ]Skipped
taos-ci commented 3 months ago

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #2540. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.

taos-ci commented 3 months ago

:octocat: cibot: @baek2sm, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2540-202404051420140.12845396995544-9b084590641606c09502ef79096695d67cd0c0db/.

taos-ci commented 3 months ago

:octocat: cibot: @baek2sm, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2540-202404051521080.72869992256165-23e5df0a40b07abae40e9bd2133689a0a97f7c3c/.

taos-ci commented 3 months ago

:octocat: cibot: @baek2sm, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/2540-202404051613580.66992688179016-23e5df0a40b07abae40e9bd2133689a0a97f7c3c/.