huchenlei / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
2 stars 0 forks source link

use_checkpoint = False #1

Closed huchenlei closed 2 months ago

huchenlei commented 2 months ago

Description

According to https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/716#discussioncomment-9342877 , calls to parameters in checkpoint function is a significant overhead in A1111. However, checkpoint function is mainly used for training, disabling it does not affect inference at all.

This PR disables checkpoint in A1111 in exchange for performance improvement. This reduces about 100ms/it on my local setup (4090). The duration/it before patch is ~580ms/it.

Screenshots/videos:

image

Checklist: