-
**The following projects are not maintained by OpenAI. I cannot vouch that any of them are correct or safe to use. Use at your own risk.**
Note that if a tokeniser fails to exactly match tiktoken's…
-
Thanks for the project. Great so far.
Is there support for counting tokens when using function calls?
https://platform.openai.com/docs/guides/gpt/function-calling
-
I made a toy GPT2 tokenizer as a python rust extension. It seems to be slightly faster than tiktoken in my tests. It looks like https://github.com/openai/tiktoken/pull/31 may get most or all the way…
-
The problem:
1. I execute [pyflink-examples/GettingStarted/getting-started.py](https://github.com/aws-samples/pyflink-getting-started/blob/main/pyflink-examples/GettingStarted/getting-started.py), …
-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### Where…
-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### Where…
-
This model's maximum context length is 4097 tokens. However, you requested 4497 tokens (497 in the messages, 4000 in the completion). Please reduce the length of the messages or completion.
-
I know the tiktoken Python library, but and even have found Java implementations like jtokkit. Do you include a tokenizer o plan to add one?
Thanks in advance.
-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### Where…
-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### Where…