search

griptape-ai / griptape

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
https://www.griptape.ai
Apache License 2.0
1.83k stars 149 forks source link

sentencepiece Tokenizer #75

Open kyleroche opened 1 year ago

kyleroche commented 1 year ago

Describe the solution you'd like tokenizer for https://github.com/google/sentencepiece/blob/master/python/README.md

This would be used for Google Vertex AI Prompt driver

derekpai commented 10 months ago

Evaluate in a month