-
### Feature request
This is a tracker issue for work on _interleaved_ in-and-out image-text generation.
There are now >= 5 open-source models that can do _interleaved_ image-text generation--and…
-
### Describe the bug
batched diffusers pipeline inference is really slow
### Reproduction
```
class prompt_data(Dataset):
def __init__(self,prompt_file):
self.txt_pr…
-
报错代码:
```
Traceback (most recent call last):
File "/workspace/qwenvl-dev/test_infer.py", line 47, in
output_ids = model.generate(**inputs, max_new_tokens=128)
File "/usr/local/lib/python…
-
I'm getting errors after trying to perform inference on an interleave model I fine-tuned using LoRA quantization
Here's the code:
```
import requests
from PIL import Image
import torch
from tr…
-
If you're encountering an error while pulling the `latest` tag of the `huggingface/text-generation-inference` Docker image, follow these steps to resolve it:
#### Steps to Fix
1. **Find the Spec…
-
How can the model evaluate on GLEU tasks?The tasks are text-pure, but in the paper it said “Similar to PLM, when prefix image is none, this task will degenerate into “text-to-image generation” task, f…
-
thanks for your perfect works , but i just see label condition , how do i use text contidion
-
### System Info
TGI from Docker
text-generation-inference:2.2.0
host: Ubuntu 22.04
NVIDIA T4 (x1)
nvidia-driver-545
### Information
- [X] Docker
- [ ] The CLI directly
### Tasks
- [X] An o…
-
Here is my result:
![image](https://github.com/user-attachments/assets/8926ce7f-17a0-490c-9ef2-912c59bbdb67)
and my code:
```
import typing as t
import asyncio
from typing import List
from …
-
the TGI image with label "text-generation-inference:latest-intel-cpu" bring up failed with "Intel/neural-chat-7b-v3-3" after the image upgraded to the build of "Created": "2024-08-20T20:17:15.74262894…