-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Feature Description
To improve search engine ranking and visibility, the website should include key SEO elemen…
-
### Problem Description
I am running into an error `no member named 'getCurrentHIPStreamMasqueradingAsCUDA' in namespace 'c10::hip'` when trying to install `ROCm/TransformerEngine` following the in…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch…
-
### Your current environment
The output of `python collect_env.py`
```text
Your output of `python collect_env.py` here
```
### Model Input Dumps
model="Qwen/Qwen2.5-72B-Instruct"
guid…
-
Server ready
INFO: Started server process [3479353]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:8000 (Press C…
-
### Your current environment
```text
The output of `python collect_env.py`
```
CODE:
from langchain.llms import VLLM
import time
import uvicorn
app = FastAPI()
llm = VLLM(model="tiiua…
-
2024-09-21 18:15:28,304 INFO worker.py:1786 -- Started a local Ray instance.
2024-09-21 18:15:28,399 INFO worker.py:1786 -- Started a local Ray instance.
Process Process-2:
Traceback (most recent c…
-
As requested Im reporting an installation issue on Windows 10, Python 3.12.3, running Spyder (v6) IDE. Normally Id use conda to manage installs except where pip is the only option.
The pip command …
-
### 🐛 Describe the bug
CUDA_VISIBLE_DEVICES=4 python -m vllm.entrypoints.openai.api_server --model PsyLLM-3.5-Turbo-09-19-Q3_K_M.gguf --trust-remote-code --port 6000 --host 0.0.0.0 --dtype auto…
-
root@fca4fb89e24a:/app# python3 geo_engine.py --import_geo_data
Traceback (most recent call last):
File "/app/geo_engine.py", line 16, in
from mongoengine import (
File "/usr/local/lib/py…