codellama-2 finetuning fails

pytorch / torchtune

PyTorch native finetuning library

https://pytorch.org/torchtune/main/

BSD 3-Clause "New" or "Revised" License

4.18k stars 403 forks source link

codellama-2 finetuning fails #1034

Closed Kushalamummigatti closed 4 months ago

Kushalamummigatti commented 4 months ago

Am using the same config file given in the recipe to finetune the CodeLlama-2 model. But am getting a strange error attached in the below SS. gitissueimage

SalmanMohammadi commented 4 months ago

Hey @Kushalamummigatti, thanks for raising this. The screenshot is just showing as a blank white image for me, could you try re-upload?

Kushalamummigatti commented 4 months ago

@SalmanMohammadi updated with new one.

SalmanMohammadi commented 4 months ago

Can you make sure you installed the nightly version? See here. I've included the command for ease:

git clone https://github.com/pytorch/torchtune.git
cd torchtune
pip install -e .

Kushalamummigatti commented 4 months ago

@SalmanMohammadi No am facing new error now.

SalmanMohammadi commented 4 months ago

Could you please confirm the version of PyTorch you have installed?

ebsmothers commented 4 months ago

@Kushalamummigatti do you still need help with this? I am going to close it since it's been stale for a bit, but if you do still need help please reopen and I will gladly take a look.