alpaca-core / ac-local

Alpaca Core local inference SDK
MIT License
1 stars 0 forks source link

Update forks and submodules #77

Closed iboB closed 1 month ago

iboB commented 2 months ago

We really need some resolution on #33 ... until then adding issues manually.

We should do this soon and again in the second half of October

iboB commented 1 month ago

Windows-only build error in ggml-cuda: Since it was small and was already done in llama, instead of finding a revision that works, I made a temporary branch of our fork and attached the submodule to it: https://github.com/alpaca-core/ggml/compare/master...alpaca-core:ggml:tmp-fix-cuda

iboB commented 1 month ago

llama_reset_timings is gone. Comment out our uses and fork to a different issue

iboB commented 1 month ago

whisper.cpp missing newly added argument to ggml_graph_plan. nullptr seems safe. Instead of redirecting all submodules, make a temporary branch to our fork and attach the submodule to it:

https://github.com/alpaca-core/whisper.cpp/compare/master...alpaca-core:whisper.cpp:tmp-ggml_graph_plan

iboB commented 1 month ago

sampling logic in llama is completely changed. Our sampler doesn't compile. Working on this

iboB commented 1 month ago

15 can be resolved as min_keep is documented and optional

iboB commented 1 month ago

Applying changes for: