Open a171232886 opened 4 months ago
The code of toolbench/inference/LLM/tool_llama_model.py#L110:
toolbench/inference/LLM/tool_llama_model.py#L110
decoded_token_len = len(self.tokenizer(predictions))
may be ?
decoded_token_len = len(self.tokenizer(predictions)['input_ids'])
The code of
toolbench/inference/LLM/tool_llama_model.py#L110
:may be ?