Open parkervg opened 5 months ago
TransformerLLM and OpenAILLM classes have a tokenizer attribute, which allows us to log prompt_tokens and completion_tokens.
TransformerLLM
OpenAILLM
tokenizer
prompt_tokens
completion_tokens
We want the same for OllamaLLM and LlamaCppLLM
OllamaLLM
LlamaCppLLM
TransformerLLM
andOpenAILLM
classes have atokenizer
attribute, which allows us to logprompt_tokens
andcompletion_tokens
.We want the same for
OllamaLLM
andLlamaCppLLM