-
Thank you for sharing your models!
```
Traceback (most recent call last):
File "/home/osboxes/Desktop/Selfless_Traffic_Routing_Testbed/main.py", line 6, in
from core.STR_SUMO import StrSum…
-
### Anything you want to discuss about vllm.
when turns on speculative decoding, the openai api server failed on concurrent requests, raising error `exceptiongroup.ExceptionGroup: unhandled errors …
-
Hi,
We can enable SR for IS-IS with:
.../network-instance/protocols/protocol/isis/global/segment-routing/config/enabled
This `segment-routing` container is defined in openconfig-segment-r…
-
For `kamu-web-ui` we designed a [nice routing scheme](https://docs.google.com/document/d/1C84w_3ungIBixWUycZjQYs52Itq_pbT7Jnl-PGOvkfA/edit) that maximally avoids collisions between `/{account}/{datase…
-
[31mERROR[0m: Exception in ASGI application
Traceback (most recent call last):
File "C:\Users\windows10\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\lo…
-
**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Can we support dynamic routing protocols…
-
New installation with "--cuda-malloc --api --listen --share --gradio-auth xxx:xxx"
```
ERROR: Exception in ASGI application████████████████████████████████████████████████| 40/40 [00:13 "DPM+…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
2024-11-04 10:14:53.454810: E external/local_xla/xla/stream_executor/cuda/cud…
-
I don't know if this might already be fixed on another branch but at least on the gui branch the Settings don't really work.
They do not change or affect the stream in the backend. Although setting …
-
`[ Linux | CUDA 12.2 | py 3.11 ]`
### Describe the bug
Hi, thanks for your awesome work!
When infering `Llama3.1/70B-Instruct/6.0bpw` over the OAI API, it throws:
```sh
INFO: 127.0.0.…