alpaca-core / ac-local

Alpaca Core local inference SDK
MIT License
1 stars 0 forks source link

Update submodules #146

Closed github-actions[bot] closed 1 week ago

github-actions[bot] commented 3 weeks ago

It's time to update our forks and submodules. Check for upstream updates and merge them if necessary.

Don't forget to use the guide.

Subbmodules to update:

iboB commented 1 week ago

llama_sampler_init_softmax will be removed in the future (see https://github.com/ggerganov/llama.cpp/pull/9896#discussion_r1800920915)

iboB commented 1 week ago

llama_batch_get_one interface has changed. New sampling API

iboB commented 1 week ago

adding two new samplers

iboB commented 1 week ago

done