sail-sg / sdft

[ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
https://aclanthology.org/2024.acl-long.58
99 stars 4 forks source link

error #1

Closed sevenandseven closed 8 months ago

sevenandseven commented 8 months ago

image

Hello, I followed the instructions to download the LLamA-Factory and bigcode into a directory, and then run the sfdt.sh file under the alpha directory, but an error occurred. Could you please tell me what the problem is and how to solve it? 屏幕截图 2024-03-19 090858

rickyang1114 commented 8 months ago

Hi, thanks for your attention!

The module train_bash is actually from LLaMA-Factory, which is used as a submodule in the main branch. As vanilla git clone without the --recurse-submodules argument doesn't install submodules, you need to install the module manually.

Here are the steps to do so:

  1. Clone submodules:
    git submodule update --init --recursive
  2. Install the LLaMA-Factory module locally:
    pip install -e LLaMA-Factory

Hope this helps.

sevenandseven commented 8 months ago

Thank you for your reply. Using your method, I was able to run the code.