-
### System Info
`
text-generation-launcher 2.1.0
`
### Information
- [X] Docker
- [X] The CLI directly
### Tasks
- [ ] An officially supported command
- [ ] My own modifications
### Reprod…
-
# Environment
Runtime environment:
- Target: x86_64-unknown-linux-gnu
- Cargo version: 1.75.0
- Commit sha: c38a7d7ddd9c612e368adec1ef94583be602fc7e
- Docker label: sha-6c4496a
Kubernetes Clus…
-
Programming Historian in English has received a proposal for a lesson, 'From Data to Dialogue: Exploring Text Collections with Large Language Models via Retrieval Augmented Generation' by @Dr-Hutchins…
hawc2 updated
2 weeks ago
-
### System Info
OS version: Ubuntu 22.04
Model being used: Qwen/Qwen2-72B-Instruct
Hardware being used: 4x 40GB A100
Deployment specificities: Running via docker using the `latest` tag as of 06/26…
-
### Describe the bug
I recently ran into an issue while using the OogaBooga Text Generation Web UI with some GGUF models. The models loaded fine into Text Gen Web UI, but when I tried to use the Open…
-
### System Info
Privately hosted instance of TGI
Version: 2.1.1
Deployed as a standalone kserve predictor
Model: Mixtral-8x7b-instruct
GPU: single A100
```
2024-07-16T16:27:39.016656Z IN…
-
- Advanced type of Language Model using Deep learning techniques using heavy text data.
- Capable of generating human like text. QnA, Text2Text
- Concepts like n-gram to Neural Networks are used. …
-
I'm trying to deploy Llama3 8b on GKE using optimum but running into some troubles.
Following instructions here: https://github.com/huggingface/optimum-tpu/tree/main/text-generation-inference. I bu…
-
### System Info
OS version: WSL 2. ubuntu 22.04
model: llama3-8B-Instruct
Hardware: no GPU
There is no gpu, but I installed the nvcc library in wsl using this command. `sudo apt install nvidia…
Hhhh8 updated
2 weeks ago
-
I'm very supportive of the proposals for Part 6 to provide simple text search. I think it would be further improved if that could be slightly extended to support simple text search across multiple col…