Open yookoala opened 1 day ago
@yookoala lightllm has not been tested in python 3.13 (too latest). so there may be some env issues. we will support python 3.13 in future. Now we suggest to use python 3.9 to install lightllm.
I believe lightllm itself is not a problem here. Rather tokenizers (https://github.com/huggingface/tokenizers/issues/1657) is depending on older pyo3, which requires Python 3.12 or below. Works like https://github.com/huggingface/tokenizers/pull/1646 could probably fix the issue.
I suggest to keep this bug alive to keep track the issue for user(s) who faces the problem.
Issue description:
I am unable to install the latest lightllm (1.24.5) with pip in Python 3.13.0 environment because one of the dependencies, PyO3, explicitly prohibit installation in Python version bigger than 3.12.x.
Steps to reproduce:
Please list the steps to reproduce the issue, such as:
pip install lightllm
Expected behavior:
Install without a problem
Error logging:
If applicable, please copy and paste the error message or stack trace here. Use code blocks for better readability.
Environment:
Please provide information about your environment, such as:
[ ] Python 3.13.0
OS: (Fedora 41)
LightLLm: 1.24.5
Additional context: