search

alpaca-core / ac-local

Alpaca Core local inference SDK
MIT License
1 stars 0 forks source link

llama: add state save/load #7

Open iboB opened 3 months ago

iboB commented 3 months ago

Intentionally skipped while implementing #3

This makes use of the llama_state* functions to preserve the state. Includes the use of session_tokens