-
### Your current environment
```
# reproduce codes:
from vllm import LLM, SamplingParams
import datasets
raw_datasets = datasets.load_dataset( "truthful_qa", 'generation')
questions = [i['qu…
-
### System Info
Although this method is un-useful, but it's little wrong
### Who can help?
_No response_…
-
https://github.com/huggingface/text-generation-inference/blob/4dfdb481fb1f9cf31561c056061d693f38ba4168/router/src/infer/v3/queue.rs#L362
When max_size is 0, but the batch_requests.len() > 0，max_bat…
-
Things to add and change in the spectral library generation.
A collection of ideas.
- [ ] add entries to existing file
- [ ] Export isotope pattern score
- [ ] option to include/exclude RT or CC…
-
Hi, I've been using your Flux Sampler node from the LLM video you put out a few months ago, it's all been working fine until the last few days so I want to check if there's an issue. I've updated all …
-
Thanks for the very helpful repo!
First, I got the code running on the example LIDC data and the training looked fine. Then I switched to my customized dataset , which looks like the following snapsh…
-
### Priority
P1-Stopper
### OS type
Ubuntu
### Hardware type
Xeon-other (Please let us know in description)
### Installation method
- [X] Pull docker images from hub.docker.com
-…
-
## Description
`grafx.data.batch_grafx` fails because `grafx.data.GRAFX.counter` does not accept `list[int]`.
## How to reproduce
```python
from grafx.data import NodeConfigs, GRAFX, batch_g…
-
Great work to start with !
I am sure you will upgrade this marvel frequently
To start with its a great UI. just need few tweaks.
1stly, I noticed that even after caption generation, offloading do…
-
I have down model weights in my computer，but i don't how to use LOCAL LLMS and Embeddings for ragas according to
Here is My code but it did't work
```
import typing as t
import asyncio
from ty…