llama: create vocab-only sessions and ops

alpaca-core / ilib-llama.cpp

Alpaca Core wrapper and plugin for llama.cpp

MIT License

0 stars 0 forks source link

Open iboB opened 3 months ago

iboB commented 3 months ago

Allow sessions and ops which are vocab-only: tokenizing strings, and converting tokens to strings.