search

pytorch / torchtune

PyTorch native finetuning library
https://pytorch.org/torchtune/main/
BSD 3-Clause "New" or "Revised" License
4.39k stars 448 forks source link

Suggestion #1951

Closed sorobedio closed 3 weeks ago

sorobedio commented 3 weeks ago

could you include an easier way to do spectrum target fine-tuning> for both instruction and others

"https://github.com/cognitivecomputations/spectrum" thank you

felipemello1 commented 3 weeks ago

hey @sorobedio , thanks for suggesting it!! Spectrum is interesting, but we currently don't have bandwidth to implement it. If you feel like contributing, please let us know. Usually the best way is to create an issue or PR with a draft/proposal, so we can review and align, and then the actual PR with the implementation.

sorobedio commented 3 weeks ago

ok i will try to do something in this regard thank you.