openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.76k stars 801 forks source link

update license metadata to use SPDX identifier as per recommendation #125

Open imrehg opened 1 year ago

imrehg commented 1 year ago

This is a housekeeping code change suggestion. This project is released under the MIT license as per the LICENSE file's contents, however the current metadata notation makes handling that information harder than it should be.

The PEP621's license field info generally recommends using a SPDX-compatible license identifier, which in this case is "MIT". Before this proposed change, other tools that use metadata-extraction (such as pip-licenses) hiccups on the license value on this library, not being able to infer that it's the same license as many other projects as well.

Given how licensing applies, I believe this should be without downside and any loss of clarity or control on the side of the project's creators, while having definite (even if niche) upside for the project's users. Happy to bring in examples from other MIT-licensed projects that use the same format.