-
In Hugging Face "eager" Mistral implementation, a sliding window of size 2048 will mask 2049 tokens. This is also true for flash attention. In the current vLLM implementation a window of 2048 will mas…
caiom updated
3 weeks ago
-
Get the models working on HuggingFace Transformers, if possible.
-
### Describe the bug
I'm trying to use a single IP adapter with multiple IP adapter images and masks. This section of the docs gives an example of how I could do that: https://huggingface.co/docs/d…
-
The issue is present in both internlm-xcomposer2-vl-7b and internlm-xcomposer2-7b, where there is a dimension mismatch between attention_mask and combined_attention_mask. The code was directly cloned …
-
### Installation Method | 安装方法与平台
Anaconda (I used latest requirements.txt)
### Version | 版本
Latest | 最新版
### OS | 操作系统
Windows
### Describe the bug | 简述
Traceback (most recent call last):
F…
-
Hello, Dr. Yang! I encountered the following error using the configuration.txt you gave. What is the cause of this?
[rank0]: Traceback (most recent call last):
[rank0]: File "/root/RiC-main/sft/sf…
-
https://huggingface.co/docs/transformers/transformers_agents
-
**Describe the bug**
After updating `autogptq` to the main branch, I encounter nan when running Qwen-7B-Chat-Int8 models. Int4 models are working well.
**Hardware details**
Nvidia A100
**Softw…
-
- description
i follow the turial for llama3 ft :[https://github.com/SmartFlowAI/Llama3-Tutorial/blob/main/docs/llava.md](https://github.com/SmartFlowAI/Llama3-Tutorial/blob/main/docs/llava.md)
i …
-
When opening the URL (http://0.0.0.0:7860) I get the "can't reach this page" message. I don't get any errors while loading, apart from the "No module named 'triton'" one, which I assume is normal on …