search

d8ahazard / sd_dreambooth_extension

Other
1.85k stars 283 forks source link

RuntimeError: Expected query, key, and value to have the same dtype, but got query.dtype: c10::Half key.dtype: float and value.dtype: float instead. #1458

Open kmlcnclk opened 5 months ago

kmlcnclk commented 5 months ago

RuntimeError: Expected query, key, and value to have the same dtype, but got query.dtype: c10::Half key.dtype: float and value.dtype: float instead.

I am getting an error like above when ı train dreambooth modal on Stable Diffusion.

Can you help me about that?

github-actions[bot] commented 4 months ago

This issue is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 30 days

vanangelov commented 3 months ago

I have the same issue on a M1 Mac. Neither using the "Upcast cross attention layer to float32" SD option, nor "--no-half" seem to fix it.

kmlcnclk commented 3 months ago

I have the same issue on a M1 Mac. Neither using the "Upcast cross attention layer to float32" SD option, nor "--no-half" seem to fix it.

I am using Mac M1 too.

vanangelov commented 3 months ago

Changing Settings > Performance > Mixed Precision to NO seems to fix this

github-actions[bot] commented 3 months ago

This issue is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 30 days

malcolmacronis commented 2 months ago

Using M1 Pro 32gb ram, nothing from above fixes this.

github-actions[bot] commented 2 months ago

This issue is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 30 days

carlokarton commented 1 month ago

Did anyone find a solution ?

github-actions[bot] commented 3 weeks ago

This issue is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 30 days