-
As per our [Slack discussion](https://seldondev.slack.com/archives/C03DQFTFXMX/p1667786578108119) with @adriangonz there is a performance overhead on MLServer in terms of received latency compared to …
-
- OS: **Ubuntu 22.04**
- GPUs: **2x 4090** (2x 24GB)
- CUDA: **11.8**
- CPU: **Ryzen 3800X**
- RAM: **64GB**
- vLLM build: **main** `400b8289`
Started the API server with this command:
```sh
…
-
I am not able to find much on batching support. But it appears that the downstream llama.cpp supports it.
https://github.com/ggerganov/llama.cpp/issues/4372
Any plans to expose this feature in k…
sirmo updated
5 months ago
-
Continuation of #3469 "Medium-sized Projects" which has grown too large for GitHub to display comfortably
Please use this thread for feedback, general discussion, questions, or requests for help / …
-
### Description
Ruby LSP and Rubocop assist does not work.
### Ruby LSP Information
#### VS Code Version
1.93.1
#### Ruby LSP Extension Version
0.7.20
#### Ruby LSP Server Version
0.17.17
###…
-
Error message:
```stderr
Traceback (most recent call last):
File "/path/to/python/env/bin/lm_eval", line 8, in
sys.exit(cli_evaluate())
^^^^^^^^^^^^^^
File "/data/user_da…
-
Hello,
Thank you for sharing your excellent work, and also for writing about it in your blog.
Thoroughly enjoyed reading the two posts about pariter.
I have a few questions/requests:
1 - Whe…
-
Common S3 implementation can benefit from random key distribution.
According to **https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance.html**
> For example, your applicatio…
-
Hi,
after migrating to a new server with new version of plesk by parallels that has **php 5.6** and **mysql 5.0.11** when the validated user try to list the report the system hangs out/freezes wit…
-
Was trying to use read_sas with modin and received this message:
```
UserWarning: `read_sas` defaulting to pandas implementation.
To request implementation, send an email to feature_requests@modin.…