-
### Problem
First linked/referenced in #1165
Shoutout to @0xced
Context: MS-SQL containers + xUnit / testing
One of the frustrating things with running DB tests and test containers is that…
-
The HTTP API currently allows an infinite number of parallel streams to be opened. This is really bad for systems which cannot afford to go down often.
To help with this situation, the HTTP API nee…
-
## CVE-2018-18074 - High Severity Vulnerability
Vulnerable Library - requests-2.19.1-py2.py3-none-any.whl
Python HTTP for Humans.
Library home page: https://files.pythonhosted.org/packages/65/47/7e0…
-
### Describe the bug
There seems to be an incorrect key path / name in the code, causing the following error (using the docker image):
```
miner_1 | 10/09/24 12:11:37 - ERROR - [post_gql_reques…
-
### Your current environment
Docker Image: vllm/vllm-openai:v0.4.3 as well as 0.5.0 post-1
Params:
```
--model=microsoft/Phi-3-medium-4k-instruct
--tensor-parallel-size=2
--disable-log-requ…
-
```
TransportError(409, u'VersionConflictEngineException[[metadata][3] [metadata][e2eaa4779fe88c8087873098fe6db01e38e86f26a403149e41323b958b0f57f1]: version conflict, current [8], provided [7]]')
``…
-
### Proposal to improve performance
_No response_
### Report of performance regression
I encountered this issue while conducting some experiments to test throughput. When using the same dataset, th…
-
### What is the issue?
We tried Ollama on our production GPU server running a RTX-4000 with a Python script that will see 10000s of requests per day from a backend for `llama3.1:latest`, simultaneo…
-
Secure node to node communication for honest but curious scenario:
- cannot use anymore the actual static (and published in library) default key for securing node to node channels
- node to node c…
-
Currently the only way to query a set of individual rows by key is to use repeated calls to `get` or `getAll`. We have some use cases where we want to query many keys with one row each (e.g. the equiv…