-
Hello,
I greatly enjoyed your paper, an am interested in understanding the approach of ranked based learning described in section 4.2. I see code here for the reconstruction of the negative labels …
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports…
-
Hi, can anyone elaborate more on the difference between the following three Tree structures?
https://github.com/NVIDIA/nccl/blob/399656269027c1818fc999ccf8ec4dd838cec50d/src/include/graph.h#L55-L57…
-
https://www.academia.edu/282562/Learning_to_Rank
https://www.semanticscholar.org/paper/Learning-to-Rank-for-Information-Retrieval-Using-Yeh-Lin/f83659a19e6373231a7609d13accf27555fd6ed8
https://link.…
-
Thank you for adding the ability to use multi-nodes without slurm! When I run training on one machine using torchrun, everything works without problems. But when I run it on two machines, the traini…
-
**Describe the bug**
I try to use pipeline parallelism with transformer, but I just found out it will be stuck in the mid
**To Reproduce**
Steps to reproduce the behavior:
```
#!/usr/bin/env py…
-
I think etext access is a very good score but we should balance it with a sort of etext quality score. (I guess we should do that for scans too but currently we can't really get some metrics about tha…
eroux updated
2 weeks ago
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports.
…
-
```
trainer = ORPOTrainer(
model=model,
train_dataset=dataset["train"],
eval_dataset=dataset["test"],
#peft_config=peft_config,
tokenizer=tokeni…
-
我严格按照README安装了相关的包
pip install -r requirements.txt
pip install git+https://github.com/unslothai/unsloth.git
pip install bitsandbytes==0.43.1
pip install peft==0.10.0
pip install torch==2.2.2
pip…