Add vocab_only - Githubissues

kherud / java-llama.cpp

Java Bindings for llama.cpp - A Port of Facebook's LLaMA model in C/C++

MIT License

279 stars 28 forks source link

Add vocab_only #70

Open ardinursyamsu opened 2 months ago

ardinursyamsu commented 2 months ago

Would you add vocab_only option just like python library do? I want to separate my tokenizer service and model service in my spring boot app.

kherud commented 2 months ago

Hey @ardinursyamsu past versions of this Java binding allowed this too, so it shouldn't be too much effort to bring this back. I'll have a look over the next few days.