TabbyML / tabby

Self-hosted AI coding assistant
https://tabby.tabbyml.com/
Other
18.25k stars 767 forks source link

feat(llama-cpp-server): upgrade to b3166 #2477

Closed wsxiaoys closed 2 days ago

codecov[bot] commented 1 week ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 56.57%. Comparing base (8f988b9) to head (ef643b2). Report is 3 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #2477 +/- ## ========================================== + Coverage 55.73% 56.57% +0.83% ========================================== Files 169 169 Lines 15087 15251 +164 ========================================== + Hits 8409 8628 +219 + Misses 6678 6623 -55 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

icycodes commented 2 days ago

Tested with:

  • TabbyML/StarCoder-1B works properly, and the completion quality is good.
  • TabbyML/DeepseekCoder-6.7B seems broken. FIM does not work properly, and the response seems to continue at the end of the suffix segment.

The re-converted DeepseekCoder-6.7B model works properly.