search

alpaca-core / ac-local

Alpaca Core local inference SDK
MIT License
1 stars 0 forks source link

llama: add control vector #11

Open iboB opened 3 months ago

iboB commented 3 months ago

Intentionally skipped while implementing #3

We should be able to apply control vectors via llama_control_vector_apply

(in main demo this is done by reading files in llama_control_vector_load from common lib)