search

sobelio / llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
https://llm-chain.xyz
MIT License
1.3k stars 128 forks source link

Add Tokenizer support for Sagemaker Endpoint Backend #213

Closed shinglyu closed 7 months ago

shinglyu commented 1 year ago

This added tokenizer support for selected models hosted on SageMaker Endpoint (in the llm-chain-sagemaker-endpoint crate). This will be helpful for chains that requires the max_token_allowed or token used information.

Juzov commented 11 months ago

Hi, sorry for responding so late. Did you take a look at the tests failing?