Closed ustcuna closed 3 months ago
Suggest to move finetune/llama/README.md into finetune/README.md for all finetune operation.
Suggest to move finetune/llama/README.md into finetune/README.md for all finetune operation.
Hi changqing, thx for pointing out that, already moved common README.md and requirements.txt to upper level folder to benefit more models for finetune.
This PR is a step-by-step example for running LLaMA2 7B lora finetuning using stock PyTorch on CPU, including single instance and distributed. Pls help to review, thx!