Closed Gooooooogo closed 1 week ago
Haven't had a chance to test or try it yet, but this looks familiar @robieta re #1374:
self._lora_ind_cache[result.device] = lora_ind = self._lora_ind.to(result.device)
NotImplementedError: Cannot copy out of meta tensor; no data!
It may or may not be related. But I'm curious when you implemented #1374 have you tested in on multi-GPU?
Should be fixed by #770
When I run
litgpt finetune lora --data Alpaca
error: