-
do we support the old V100 GPUs with FlexAttention ?
-
In the train_lcm_distill_sd_wds.py
# 20.4.6. Sample a random guidance scale w from U[w_min, w_max] and embed it
w = (args.w_max - args.w_min) * torch.r…
-
### Feature request
Is there a tutorial for using DeepSpeed's activation checkpointing instead of PyTorch's?
I'm using `Trainer` with ZeRO integration to train my model. Here's my code:
```py…
-
Hello, I would like to ask how Kangaroo works in scenarios where bsz is greater than 1, and which parts of the code need to be modified. Thank you!
-
### 🐛 Describe the bug
I've been making a lot of tickets about differentiating through things lately, but here's a much more basic one: if I export a self attention layer from a transformer to on o…
-
hi, I have attention_mask problem mismatch in the cross attenstion
can you please explain this line:
requires_attention_mask = "encoder_outputs" not in model_kwargs ?
why is comed after this:
…
-
Hello.
First, I know that batch size is even number with bi_data
How about between attention type(uni- or bi-)??
Is it related to batch size even or odd??
-
I created a script to check the tokens_per_second and peak_memory for any config/recipe testing different flags.
It still needs some polishing, but I wanted to get comments about the outcome before …
-
您好,使用原始代码在2张A100 80G上面微调qwen,显存占用两张卡上都只有919M,但是在数据加载过程中?内存占用一直在增加,直到180多G后内存爆了,程序终止。请问这个问题怎么解?
训练log:
![image](https://github.com/TideDra/VL-RLHF/assets/36758049/09277b55-ea0a-4cfd-875b-792f457441a2…
-
We've encountered an issue while using a local endpoint deployed by Text Generation Inference (TGI) and the vLLM API. When evaluating using the **local-completion** format, we receive an error indicat…