Closed yangbobo2021 closed 5 months ago
This pull request includes two key improvements to the CLI:
A new cache directory for Tiktoken has been added during the CLI initialization process to enhance performance and persistence.
The request handler now explicitly uses response_format to return results in JSON format, ensuring consistency in response data structures.
response_format
These enhancements should provide a more robust and reliable user experience.
Please review the changes and let me know if there are any concerns or further optimizations we can implement.
This pull request includes two key improvements to the CLI:
A new cache directory for Tiktoken has been added during the CLI initialization process to enhance performance and persistence.
The request handler now explicitly uses
response_formatto return results in JSON format, ensuring consistency in response data structures.These enhancements should provide a more robust and reliable user experience.
Please review the changes and let me know if there are any concerns or further optimizations we can implement.