Running LoRA + QLoRA on Colab Notebooks

pytorch / torchtune

A Native-PyTorch Library for LLM Fine-tuning

https://pytorch.org/torchtune/main/

BSD 3-Clause "New" or "Revised" License

3.94k stars 357 forks source link

Open kartikayk opened 4 months ago

kartikayk commented 4 months ago

Using this issue to track the work we need to do to enable this. We'll capture our learnings, TODOs and PRs over here so everyone can follow along.

RdoubleA commented 3 weeks ago

This is being actively worked on in #1315. What are all the gaps that are remaining?