-
I've been testing running various finetuned versions of supported models on GKE. However, it gets stuck on ` Using the Hugging Face API to retrieve tokenizer config`
This are the full logs
```…
-
### System Info
Docker v2.1.1
Ubuntu 22.04, 8xA6000 Ampere
Nvidia Driver: v555.42.02 / CUDA Version: 12.5
### Information
- [X] Docker
- [ ] The CLI directly
### Tasks
- [X] An officially suppo…
-
### System Info
Command Causing Issue:
```
model=microsoft/Phi-3-mini-4k-instruct
volume=$PWD/data # share a volume with the Docker container to avoid downloading weights every run
docker run -…
-
### System Info
Target: x86_64-unknown-linux-gnu
Cargo version: 1.78.0
Commit sha: 96b7b40ca3e39f7ca5b875bff9a4665c1b175289
Docker label: sha-96b7b40-rocm
### Information
- [ ] Docker
- [ ] The …
-
![image](https://uploads.linear.app/0a832749-6bfc-40ec-ae6f-821fa8081d92/b03fef57-cff5-4cb6-a839-b70fec68562f/8d292dcc-3f04-4f14-8d12-2b743282b435?signature=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJwYX…
-
### Describe the bug
My past chats widget fail to load because of old or malformed chat content in the logs, and when I fix it to workaround the data issues, there are still more issues loading old…
-
### System Info
`
text-generation-launcher 2.1.0
`
### Information
- [X] Docker
- [X] The CLI directly
### Tasks
- [ ] An officially supported command
- [ ] My own modifications
### Reprod…
-
### System Info
OS version: Ubuntu 22.04
Model being used: Qwen/Qwen2-72B-Instruct
Hardware being used: 4x 40GB A100
Deployment specificities: Running via docker using the `latest` tag as of 06/26…
-
### Describe the bug
I recently ran into an issue while using the OogaBooga Text Generation Web UI with some GGUF models. The models loaded fine into Text Gen Web UI, but when I tried to use the Open…
-
- Advanced type of Language Model using Deep learning techniques using heavy text data.
- Capable of generating human like text. QnA, Text2Text
- Concepts like n-gram to Neural Networks are used. …