[Finetune] Scripts for Llama2-7b lora finetune example using stock pytorch

intel / xFasterTransformer

Apache License 2.0

344 stars 60 forks source link

[Finetune] Scripts for Llama2-7b lora finetune example using stock pytorch #327

Closed ustcuna closed 3 months ago

ustcuna commented 4 months ago

This PR is a step-by-step example for running LLaMA2 7B lora finetuning using stock PyTorch on CPU, including single instance and distributed. Pls help to review, thx!

changqi1 commented 4 months ago

Suggest to move finetune/llama/README.md into finetune/README.md for all finetune operation.

ustcuna commented 4 months ago

Suggest to move finetune/llama/README.md into finetune/README.md for all finetune operation.

Hi changqing, thx for pointing out that, already moved common README.md and requirements.txt to upper level folder to benefit more models for finetune.