Can you share your create svdq-int4-flux.1-dev.safetensors script?

mit-han-lab / nunchaku

SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models

https://hanlab.mit.edu/projects/svdquant

Apache License 2.0

267 stars 14 forks source link

Can you share your create svdq-int4-flux.1-dev.safetensors script? #10

Closed chuck-ma closed 2 days ago

chuck-ma commented 2 days ago

Hi, thanks for your work. But I'm wondering how to create an int4 model like svdq-int4-flux.1-dev.safetensors, because I have a model fine-tuned from the dev model.

chuck-ma commented 2 days ago

Gotcha, it seems that i should use deepcompressor to create w4a4 quantized model