Can I know the python version and triton version you are using, I have an issue with 3.12.7 that I am using without a suitable version of triton, which cannot be done in a certain step: vllm serve OpenGVLab/InternVL2-Llama3-76B --served-model-name internlm2 --tensor-parallel-size 4
and the libraries in the requirements do not seem to be complete, and I have encountered installation problems with other libraries (e.g. triton) when configuring the environment, can you provide some more configuration details to help me reproduce the paper
george13zyx
commented
3 days ago
Can I know the python version and triton version you are using, I have an issue with 3.12.7 that I am using without a suitable version of triton, which cannot be done in a certain step: vllm serve OpenGVLab/InternVL2-Llama3-76B --served-model-name internlm2 --tensor-parallel-size 4
and the libraries in the requirements do not seem to be complete, and I have encountered installation problems with other libraries (e.g. triton) when configuring the environment, can you provide some more configuration details to help me reproduce the paper