-
### System Info
As in the title.
### Information
- [ ] Docker
- [X] The CLI directly
### Tasks
- [ ] An officially supported command
- [ ] My own modifications
### Reproduction
I tried to ins…
-
### System Info / 系統信息
streamlit run main.py
ModuleNotFoundError: No module named 'huggingface_hub.inference._text_generation'
### Who can help? / 谁可以帮助到您?
_No response_
### Information / 问题信…
-
If you're encountering an error while pulling the `latest` tag of the `huggingface/text-generation-inference` Docker image, follow these steps to resolve it:
#### Steps to Fix
1. **Find the Spec…
-
### System Info
TGI from Docker
text-generation-inference:2.2.0
host: Ubuntu 22.04
NVIDIA T4 (x1)
nvidia-driver-545
### Information
- [X] Docker
- [ ] The CLI directly
### Tasks
- [X] An o…
-
Thanks for your great work. However, in our experiment, we tried different text prompts according to your instruction (the dataset preparation and inference code), the video generation results are alm…
-
### System Info
Iam refferng to [https://github.com/huggingface/text-generation-inference?tab=readme-ov-file#local-install](https://github.com/huggingface/text-generation-inference?tab=readme-ov-fil…
-
HuggingFace has a standard TGI/Docker type container for serving LLM requests.
It would be useful to take advantage of HuggingFace features for TGI generation.
* Github: [Large Language Model Te…
-
无法加载模型,后台报错:
1.当前版本为PYTHON 3.11.9,之前试过PYTHON3.10.X也报错
2. xinference . 0.12.2
3. pip install "xinference[all]" 安装后本地环境运行
4. Full stack of the error.
Traceback (most recent call last):
File …
-
STEP 1/32: FROM ghcr.io/huggingface/text-generation-inference:latest
Trying to pull ghcr.io/huggingface/text-generation-inference:latest...
Error: creating build container: choosing an image from ma…
-
# Prerequisites
When I install via pip install llama-cpp-python, there will be an error. It will occur on versions 0.2.81 and 0.2.80, The version 0.2.79 can be successfully installed.
python 3.11…