Added tokenization examples.

kaust-generative-ai / local-deployment-llama-cpp

Project to help you get started working with LLMs locally with LLaMA C++.

Apache License 2.0

1 stars 1 forks source link

Closed davidrpugh closed 1 month ago

davidrpugh commented 1 month ago

This PR adds basic usage example for /tokenize and /detokenize endpoints.