search

cohere-ai / cohere-python

Python Library for Accessing the Cohere API
https://docs.cohere.ai
MIT License
286 stars 63 forks source link

Update tokenizers version #483

Closed kilimchoi closed 4 months ago

kilimchoi commented 4 months ago

Is it possible to update the tokenizers' version? We're using the latest transformers python package and it requires tokenizers' version to be >=0.19,<0.20

billytrend-cohere commented 4 months ago

Hey, bumped it to ^0.19 in 5.3.3, thanks for reporting!

ShreyPandit commented 3 months ago

Hi, This issue got resolved with 5.3.3 but again pops up with the latest 5.5.6