search

nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
9.21k stars 715 forks source link

Questions about package installation of vllm==0.1.4. #229

Open AcRush420 opened 9 months ago

AcRush420 commented 9 months ago

When I installed package vllm==0.1.4. It turned out that"Collecting torch>=2.0.0 (from vllm==0.1.4)" which didn't meet your environment conda install pytorch==1.12.0 torchvision==0.13.0 torchaudio==0.12.0 cudatoolkit=11.3 -c pytorch.

The installation process of vllm==0.1.4 automaticly uninstall the old version of pytorch==1.12.0 and install the new version of pytorch.

ChiYeungLaw commented 9 months ago

yes. this would be fine to use torch>=2.0.0.