search

vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs
https://docs.vllm.ai
Apache License 2.0
26.69k stars 3.91k forks source link

[Installation]: Error when importing LLM from vllm #5086

Open manishkumar0709 opened 3 months ago

manishkumar0709 commented 3 months ago

My current environment

i am using linux system, rtx 4080, cuda version: 12.1, python version - 3.9

from vllm import LLM
ImportError: cannot import name 'LLM' from 'vllm' (unknown location)

How you are installing vllm

pip install vllm
DarkLight1337 commented 3 months ago

Can you run pip list and see if vllm is in the list of installed packages? If you're managing multiple Python environments, double-check that you're using the correct one.

manishkumar0709 commented 2 months ago

yes i have installed correctly , had doubled check

DarkLight1337 commented 2 months ago

Has this problem been resolved?