alpaca-core / ac-local

Alpaca Core local inference SDK
MIT License
1 stars 0 forks source link

Update submodules #109

Closed github-actions[bot] closed 1 month ago

github-actions[bot] commented 1 month ago

It's time to update our forks and submodules. Check for upstream updates and merge them if necessary.

Don't forget to use guide.

Subbmodules to update:

iboB commented 1 month ago

perf sampling was improved in llama.cpp upstream which break our build. Working on it

iboB commented 1 month ago

found crash in ggml (bug). Fix, fork, redirect, make PR

https://github.com/ggerganov/ggml/pull/973

iboB commented 1 month ago

llama: disabling context shift may be relevant https://github.com/alpaca-core/llama.cpp/commit/441b72b91f818fe69497e5816f87969e90c73c43 but we already cover this

Still this begs the question remains whether we should handle a full context with an exception or allow non-exceptional break path.

We will decide if it becomes an issue.