search

mistralai / mistral-common

Apache License 2.0
633 stars 57 forks source link

mistral-common > 1.0.2 is broken - issue with v3 tokenizer #11

Closed sachinsshetty closed 4 months ago

sachinsshetty commented 4 months ago

False Alarm - mistral-common==1.0.2 Executes properly

mistral-common version 1.1.0 and 1.2.0 are breaking.

Tokenizer example is failing - https://github.com/mistralai/mistral-common/blob/main/examples/tokenizer.ipynb