Open sachinchandra opened 1 month ago
We refactored the vLLM code today, the new code and image are in the CI/CD progress, while the doc is updated first.
Please try python -m ipex_llm.vllm.entrypoints.openai.api_server
for today's ipex-llm build.
And with the nightly build tomorrow, please follow the doc.
followed installation of Vllm via this link
tried running via docker too: Here is the image
Still getting the no module named ipex_llm.vllm.xpu
Using currently on Arc A770