Closed shinglyu closed 7 months ago
This added tokenizer support for selected models hosted on SageMaker Endpoint (in the llm-chain-sagemaker-endpoint crate). This will be helpful for chains that requires the max_token_allowed or token used information.
Hi, sorry for responding so late. Did you take a look at the tests failing?
This added tokenizer support for selected models hosted on SageMaker Endpoint (in the llm-chain-sagemaker-endpoint crate). This will be helpful for chains that requires the max_token_allowed or token used information.