-
### Anything you want to discuss about vllm.
Hi,
I am running some benchmarks on the `vllm.entrypoints.openai.api_server` measuring latency and throughput with different number of concurrent reque…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
### What would your feature do ?
SD.NET has preliminarily supported the use …
zcq06 updated
2 months ago
-
### Describe the workflow you want to enable
Per https://github.com/scikit-learn/scikit-learn/pull/22554 such workflow is possible:
```python
from sklearn.datasets import make_classification
f…
-
### Ticket Contents
## Description
Digital Bharat Collaborative (DBC) is an initiative of Piramal Swasthya, the healthcare arm of the Piramal Foundation. DBC's focus areas include building a robu…
-
This is the issue where I log all my processes while adding ReQue's expanders to RePair.
-
I brought this up in a couple of places, but I think it's important enough to have it being tracked as a separate issue. We often use the tenet "Simple things should be simple, complex things should b…
-
Hello
I was trying out the `mlx-vlm` package and was able to run the default example [here](https://huggingface.co/mlx-community/llava-1.5-7b-4bit)
However, replacing the model card with [Effici…
-
### 🚀 The feature, motivation and pitch
I found a blog post explaining how to get speedups by using int8 gemm kernels on CUDA: https://www.speechmatics.com/company/articles-and-news/fast-and-accura…
-
**Describe the bug**
Nodes created in the n8n/packages/nodes-base/nodes/{NODE_NAME} have an inconsistent file structure which makes modifying/understanding how existing nodes work quite confusing. Fo…
-
### 🐛 Describe the bug
Context: We have more and more situations where a large part of the model that's being trained is frozen. As these are very large LLMs, we want to leverage FSDP with CPU offl…