tdrussell / qlora-pipe

A pipeline parallel training script for LLMs.
MIT License
83 stars 8 forks source link

merge_lora: switch copy order and add tqdm #5

Closed kallewoof closed 5 months ago

kallewoof commented 5 months ago

The order switch is done as there are often big quant files in the input directory that are inadvertently copied over to the new location (gguf files in particular). By copying first, the user is able to abort and redo the process with the files cleaned out, without having to wait for the merge to finish before finding out.