pytorch / torchtune

PyTorch native finetuning library
https://pytorch.org/torchtune/main/
BSD 3-Clause "New" or "Revised" License
4.35k stars 440 forks source link

Can we get XPU Nightlies? #2005

Open Jack-Khuu opened 1 week ago

Jack-Khuu commented 1 week ago

I'm working with @jenniew over on torchchat to add XPU support for the Intel side: https://github.com/pytorch/torchchat/pull/1361 And we noticed that tune doesn't have XPU nightlies, so we have to default back to 0.3.1.

Ask: Is there appetite for/can we get XPU nightlies?

RdoubleA commented 6 days ago

There was a request around this quite a while back: #999. A community contributor put up a draft PR for enabling this but we never followed up: #1280. There is still work to make sure our recipes support XPU and we have CI that tests XPU before we can get XPU nightlies.

Jack-Khuu commented 6 days ago

Do we spin up XPU versions for major releases (e.g. 0.4.0)? If so we may lean on that temporarily from the torchchat side so versions don't diverge too far from main