search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.61k stars 785 forks source link

Add Python 3.12 build wheel #200

Closed rinarakaki closed 8 months ago

tonybaloney commented 10 months ago

Fixes #205

Ayfri commented 10 months ago

Any update ?

barrenechea commented 10 months ago

@hauntsaninja when you have a moment, could you look at this PR? Your input would be greatly appreciated!

cipri-tom commented 9 months ago

@hauntsaninja it would be great to have wheels for 3.12 🙏 . Thank you !

sneils commented 9 months ago

It's one of the packages that prevents our move to 3.12. Would be great to have the wheels ready :)

aemr3 commented 9 months ago

We’re waiting for this too @hauntsaninja

hauntsaninja commented 8 months ago

Thanks for the PR! This isn't quite sufficient, I think we also need to update cibuildwheel for 3.12 wheels to be built correctly. I've pushed this change to main and tiktoken 0.5.2 will have 3.12 wheels :-)

rinarakaki commented 8 months ago

Thanks!

rinarakaki commented 8 months ago

Any updates?

hauntsaninja commented 8 months ago

https://pypi.org/project/tiktoken/0.5.2/#files

rinarakaki commented 8 months ago

Ah, only subscribing to releases from this repository. Just appreciate it!

hauntsaninja commented 8 months ago

Thanks, I made a Github release corresponding to the 0.5.2 tag as well :-)