Closed Krovius closed 3 weeks ago
Existing source attempts to pass a string as 'Prompt' to the tokenizer and performs a len() on a dict, returning the number of members and not the token count.
Existing source attempts to pass a string as 'Prompt' to the tokenizer and performs a len() on a dict, returning the number of members and not the token count.