-
### System Info
`text-generation-launcher --env:`
```
2024-08-28T05:17:36.254761Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.79.0
Comm…
-
Below is the code I am using but this generated output with input and instructions.
# alpaca_prompt = Copied from above
FastLanguageModel.for_inference(model) # Enable native 2x faster inference
…
-
**Describe the bug**
When using a standard RAG pipeline I get the above error.
**Error message**
```
File "/home/felix/PycharmProjects/anychat/src/anychat/analysis/rag.py", line 124, in qu…
-
### System Info
Transformers Patch release v4.45.2
PyTorch 1.10.1
Python 3.8.0
cuda 11.1
NVIDIA V100
### Who can help?
@gante @zucchini-nlp @Rocketknight1
### Information
- [ ] The official …
-
**Describe the bug**
inference_zero_shot的方法输入如果没有以标点结尾，会导致只采取一部分文字生成语音
**To Reproduce**
- input text:
首先，让我们来认识一下今天的讲师嘉山老师。嘉山老师是绩效提升和团队管理实战专家，曾在字节跳动（抖音）担任最佳绩效教练
- the text contained in the …
-
Hello,
Your paper looks very promising. I can't wait the release of model and code 😍
Could you provide more information about inference speed? And max resolution of generated video?
-
### System Info
```shell
Image: vault.habana.ai/gaudi-docker/1.17.1/ubuntu22.04/habanalabs/pytorch-installer-2.3.1:latest
harware: Habana Labs Gaudi HL205 Mezzanine Card with HL-2000 AI Training …
-
How to do the inference on multi-images? I try to input 2 images, but enconter a error ValueError: Number of image tokens in input_ids (1) different from num_images (2). Here is my code:
---------…
-
# ComfyUI Error Report
## Error Details
- **Node ID:** 6
- **Node Type:** maskgct_run_v2
- **Exception Type:** Exception
- **Exception Message:** Unknown language:
## Stack Trace
```
File…
-
Great work!
How to perform the task of generating video captions？