search

langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
https://dify.ai
Other
51.83k stars 7.51k forks source link

分词如何扩容 #600

Closed lyzklkl closed 1 year ago

lyzklkl commented 1 year ago

我们打算使用 ChatGPT4, 希望分词能扩展到更大的可能, 但是我现在迫切要解决这个问题, 请问有什么办法解决吗? custom segment length should be between 50 and 1000

github-actions[bot] commented 1 year ago

Close due to it's no longer active, if you have any questions, you can reopen it.