cloneofsimo / lora

Using Low-rank adaptation to quickly fine-tune diffusion models.
https://arxiv.org/abs/2106.09685
Apache License 2.0
7.03k stars 480 forks source link

Make safetensors properly optional, and support storing TI #101

Closed hafriedlander closed 1 year ago

hafriedlander commented 1 year ago

Not fully tested yet, just raising to start reviewing.

Should be fully backwards compatible on API, and make safetensors a properly optional dependancy (loading should work with the pure python version, saving requires the module but the default training script behaviour is to skip and only write pytorch models if it's not available)

hafriedlander commented 1 year ago

OK, all my testing passed fine

cloneofsimo commented 1 year ago

Nice feature. Good that these passed tests, I think i'll add them to the CLI training as well.