search

cccntu / minLoRA

minLoRA: a minimal PyTorch library that allows you to apply LoRA to any PyTorch model.
MIT License
432 stars 29 forks source link

FSDP #3

Open ariesadel opened 1 year ago

ariesadel commented 1 year ago

Can this be used with FSDP? I haven't seen any examples of using torch.nn.utils.parametrize with FSDP.