castorini / daam

Diffusion attentive attribution maps for interpreting Stable Diffusion.
MIT License
689 stars 63 forks source link

Support for Stable Diffusion 2 (non-base) | 768x768 tensor size #14

Open federicotorrielli opened 1 year ago

federicotorrielli commented 1 year ago

Title. DAAM currently (as per 0.9.0) only supports SD2 512x512 while the original model has 768x768 sizes.

daemon commented 1 year ago

Does daam "Cat and dog" --model v2-large work? Check out the daam/run/generate.py script.

See below: output giraffe heat_map refrigerator heat_map

federicotorrielli commented 1 year ago

All I get from my code is this: image

federicotorrielli commented 1 year ago

Relevant code parts: image and image

daemon commented 1 year ago

Ah, I see. So for expand_image, you'll need to pass in out=768.

federicotorrielli commented 1 year ago

@daemon Thanks a lot. Do you want me to close the issue or keep it open for new users?

daemon commented 1 year ago

It'll help to keep it open, as I'll be adding documentation for that.