-
### System Info
TGI version: 2.2.0 (but I tested 2.3.0 too)
Machine: 8x H100 (640 GPU RAM)
```
2024-09-25T14:29:44.260160Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unkn…
-
**Describe the bug**
The behavior is a bit random. **When the text generation input size < batch size from the previous step** and replica > 1. The final output could missing some samples. This does …
-
### Describe the bug
After placing the JSON and PNG in their respective areas, and hitting the submit button to upload a character, I get the following error:
```
Traceback (most recent call last…
-
### Feature request
This is a tracker issue for work on _interleaved_ in-and-out image-text generation.
There are now >= 5 open-source models that can do _interleaved_ image-text generation--and…
-
Wrote the according to the following example at https://distilabel.argilla.io/latest/sections/how_to_guides/advanced/serving_an_llm_for_reuse/#serving-llms-using-vllm:
```
from distilabel.llms im…
-
A notebook that demonstrates how to use a multimodal RAG that combines two types of inputs, such as text and images, to retrieve relevant information from a dataset and generate new outputs based on t…
-
The purpose of this RFC is to get early feedback on this new full-stack AI functionality in Amplify. This functionality is currently in developer preview while we get feedback and iterate on it. There…
-
### Project Name
MyFitnessBuddy - AI powered Fitness Assistant
### Description
# RagHack - GenAI Fitness Advisor App
## Problem Definition:
![banner](https://static01.nyt.com/images/2024…
-
### System Info
Hi everyone, when trying to update from Llama 3 8B Instruct to Llama 3.1 8B Instruct, I noticed a crash:
```bash
Args {
model_id: "meta-llama/Meta-Llama-3.1-8B-Instruct",
…
-
### System Info
TGI from Docker
text-generation-inference:2.2.0
host: Ubuntu 22.04
NVIDIA T4 (x1)
nvidia-driver-545
### Information
- [X] Docker
- [ ] The CLI directly
### Tasks
- [X] An o…