mistralai / mistral-common

Apache License 2.0
463 stars 36 forks source link

Incorrect import in tokenizer colab notebook #8

Open RdoubleA opened 1 month ago

RdoubleA commented 1 month ago

Hello folks, a lot of awesome tools here :) I was going through the tokenizer notebook to understand how the template has changed with tool calling and I wasn't able to run it. It looks like one of the imports needs to be updated:

ModuleNotFoundError: No module named 'mistral_common.tokens.instruct.normalize'

I believe this just needs to be updated to from mistral_common.protocol.instruct.request import ChatCompletionRequest?

almatkai commented 1 month ago

I have the same issue. I can not count my tokens

matheus-prandini commented 3 weeks ago

@RdoubleA Same here. I opened a PR today with this fix.

wissamee commented 1 week ago

change it with this from mistral_common.protocol.instruct.request import ChatCompletionRequest