Open Carsonthemonkey opened 1 year ago
word count doesn't work in japanese. Maybe this won't matter if we just change it to a token counter, but if we don't do that, we may want to consider making a more robust algorithm.
word count doesn't work in japanese. Maybe this won't matter if we just change it to a token counter, but if we don't do that, we may want to consider making a more robust algorithm.