added fn using tokkit token count

zmedelis / bosquet

Tooling to build LLM applications: prompt templating and composition, agents, LLM memory, and other instruments for builders of AI applications.

https://zmedelis.github.io/bosquet/

Eclipse Public License 1.0

277 stars 18 forks source link

Closed behrica closed 1 year ago

behrica commented 1 year ago

added function to allow split on precise token count

zmedelis commented 1 year ago

Nice thanks for submitting!