-
Recently, I have experimented DPO training for Vietnamese. I start with a strong SFT model, which is [vinai/PhoGPT-4B-Chat](https://huggingface.co/vinai/PhoGPT-4B-Chat), and follow the method describe…
-
### Feature request
🤗 Accelerate has a gradient accumulation wrapper, and the `no_trainer` scripts should be updated to include it!
An example can be seen [here](https://github.com/huggingface/…
-
I'm still new to this codebase and may not have a perfect understanding or description of how the engine handles imported functions or epoch canceling. Any feedback is appreciated.
#### Improvement…
-
## 环境准备 (Environmental Preparation)
```bash
# 安装ms-swift (Install ms-swift)
pip install git+https://github.com/modelscope/swift.git#egg=ms-swift[llm]
# 安装最新的transformers(Install the latest trans…
-
I have modified the code for my own remote sensing data and used bounding box prompts for guidance, but during training, the IoU on the validation set is extremely poor.
我修改成自己的遥感数据,并使用框提示进行提示.但我在训练的…
-
## How to reproduce the behaviour
I cannot reproduce the same results when training a NER model using GPU in Google Colab.
When running the same code with CPU it seems to work.
However, when enab…
-
rt,
I have pair data, I try to feed the image to the CLIP and output the image embedding(not updated), and use the 'bert-base-multilingual-uncased' model to train the two-tower model according to [t…
-
I run pytorch version run_mlm_no_trainer.py with lightseq. But the result is a big difference。
run on my own data without lightseq
https://github.com/huggingface/transformers/blob/master/examples/…
-
I am try 4 different datasets. The biggest one contains 4 languages with 20600 pngs with 10 second spectrogramm for each language.
No luck. Train accuracy is 0.97 Validation and Test accuracy is 0…
-
Guys, I ran the current setup on the full librispeech data for 3 epochs and this issue is mostly just an FYI so you can see what I got. I am thinking perhaps we can start doing experiments on full-li…