search

vladmandic / automatic

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models
https://github.com/vladmandic/automatic
GNU Affero General Public License v3.0
5.3k stars 377 forks source link

[Issue]: Dragging image into text fields does not populate its generation metadata #2776

Open DrakeRichards opened 5 months ago

DrakeRichards commented 5 months ago

Issue Description

When dragging a .png file generated by Stable Diffusion into any parameter text input field, the cursor now shows 🚫 and will not allow me to drop the image into the field. This prevents me from being able to print out the image's generation metadata. Tested this on the positive and negative input fields in the Text and Image tabs.

image

Workaround: I can drop the image into the "Process" tab and this does allow me to grab the metadata.

Version Platform Description

Relevant log output

2024-01-29 20:59:28,955 | sd | INFO | launch | Starting SD.Next
2024-01-29 20:59:28,959 | sd | INFO | installer | Logger: file="E:\AI\sdnext\sdnext.log" level=INFO size=1091521 mode=append
2024-01-29 20:59:28,961 | sd | INFO | installer | Python 3.11.7 on Windows
2024-01-29 20:59:29,153 | sd | INFO | installer | Version: app=sd.next updated=2024-01-29 hash=2a5b98c3 url=git@github.com:DrakeRichards/stable-diffusion-webui.git/tree/master
2024-01-29 20:59:29,814 | sd | INFO | launch | Platform: arch=AMD64 cpu=AMD64 Family 23 Model 8 Stepping 2, AuthenticAMD system=Windows release=Windows-10-10.0.22621-SP0 python=3.11.7
2024-01-29 20:59:29,816 | sd | DEBUG | installer | Setting environment tuning
2024-01-29 20:59:29,816 | sd | DEBUG | installer | Cache folder: C:\Users\thoma\.cache\huggingface\hub
2024-01-29 20:59:29,817 | sd | DEBUG | installer | Torch overrides: cuda=False rocm=False ipex=False diml=False openvino=False
2024-01-29 20:59:29,817 | sd | DEBUG | installer | Torch allowed: cuda=True rocm=True ipex=True diml=True openvino=True
2024-01-29 20:59:29,823 | sd | INFO | installer | nVidia CUDA toolkit detected: nvidia-smi present
2024-01-29 20:59:30,002 | sd | DEBUG | installer | Repository update time: Sun Jan 28 19:01:37 2024
2024-01-29 20:59:30,003 | sd | DEBUG | installer | Previous setup time: Mon Jan 29 20:35:24 2024
2024-01-29 20:59:30,017 | sd | INFO | installer | Extensions: disabled=['sd-webui-controlnet']
2024-01-29 20:59:30,019 | sd | INFO | installer | Extensions: enabled=['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg'] extensions-builtin
2024-01-29 20:59:30,067 | sd | INFO | installer | Extensions: enabled=[] extensions
2024-01-29 20:59:30,069 | sd | DEBUG | installer | Latest extensions time: Mon Jan 29 20:59:10 2024
2024-01-29 20:59:30,069 | sd | DEBUG | installer | Timestamps: version:1706490097 setup:1706582124 extension:1706583550
2024-01-29 20:59:30,069 | sd | INFO | launch | Startup: standard
2024-01-29 20:59:30,070 | sd | INFO | installer | Verifying requirements
2024-01-29 20:59:30,104 | sd | INFO | installer | Verifying packages
2024-01-29 20:59:30,107 | sd | INFO | installer | Verifying submodules
2024-01-29 20:59:33,872 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-extension-chainner / main
2024-01-29 20:59:34,005 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-extension-system-info / main
2024-01-29 20:59:34,122 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-webui-agent-scheduler / main
2024-01-29 20:59:34,231 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-webui-controlnet / main
2024-01-29 20:59:34,476 | sd | DEBUG | installer | Submodule: extensions-builtin/stable-diffusion-webui-images-browser / main
2024-01-29 20:59:34,598 | sd | DEBUG | installer | Submodule: extensions-builtin/stable-diffusion-webui-rembg / master
2024-01-29 20:59:34,747 | sd | DEBUG | installer | Submodule: modules/k-diffusion / master
2024-01-29 20:59:34,845 | sd | DEBUG | installer | Submodule: modules/lora / main
2024-01-29 20:59:34,974 | sd | DEBUG | installer | Submodule: wiki / master
2024-01-29 20:59:35,028 | sd | DEBUG | paths | Register paths
2024-01-29 20:59:35,203 | sd | DEBUG | installer | Installed packages: 218
2024-01-29 20:59:35,203 | sd | DEBUG | installer | Extensions all: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg']
2024-01-29 20:59:35,550 | sd | DEBUG | installer | Running extension installer: E:\AI\sdnext\extensions-builtin\sd-extension-system-info\install.py
2024-01-29 20:59:36,179 | sd | DEBUG | installer | Running extension installer: E:\AI\sdnext\extensions-builtin\sd-webui-agent-scheduler\install.py
2024-01-29 20:59:36,762 | sd | DEBUG | installer | Running extension installer: E:\AI\sdnext\extensions-builtin\stable-diffusion-webui-images-browser\install.py
2024-01-29 20:59:37,345 | sd | DEBUG | installer | Running extension installer: E:\AI\sdnext\extensions-builtin\stable-diffusion-webui-rembg\install.py
2024-01-29 20:59:37,932 | sd | DEBUG | installer | Extensions all: []
2024-01-29 20:59:37,933 | sd | INFO | installer | Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg']
2024-01-29 20:59:37,934 | sd | INFO | installer | Verifying requirements
2024-01-29 20:59:37,951 | sd | DEBUG | launch | Setup complete without errors: 1706583578
2024-01-29 20:59:38,041 | sd | INFO | installer | Extension preload: {'extensions-builtin': 0.07, 'E:\\AI\\sdnext-rpg\\extensions': 0.0}
2024-01-29 20:59:38,043 | sd | DEBUG | launch | Starting module: <module 'webui' from 'E:\\AI\\sdnext\\webui.py'>
2024-01-29 20:59:38,043 | sd | INFO | launch | Command line args: ['--models-dir', 'C:\\Users\\thoma\\ai-common\\models-diffusers', '--data-dir', 'E:\\AI\\sdnext-rpg', '--backend', 'diffusers', '--listen', '--insecure', '--docs', '--medvram'] medvram=True data_dir=E:\AI\sdnext-rpg models_dir=C:\Users\thoma\ai-common\models-diffusers insecure=True listen=True docs=True backend=diffusers
2024-01-29 20:59:38,046 | sd | DEBUG | launch | Env flags: []
2024-01-29 21:00:12,949 | sd | INFO | loader | Load packages: torch=2.1.2+cu121 diffusers=0.25.0 gradio=3.43.2
2024-01-29 21:00:17,150 | sd | DEBUG | shared | Read: file="E:\AI\sdnext-rpg\config.json" json=31 bytes=1565 time=0.001
2024-01-29 21:00:17,151 | sd | INFO | shared | Engine: backend=Backend.DIFFUSERS compute=cuda mode=no_grad device=cuda cross-optimization="Scaled-Dot-Product"
2024-01-29 21:00:17,240 | sd | INFO | shared | Device: device=NVIDIA GeForce RTX 3060 Ti n=1 arch=sm_90 cap=(8, 6) cuda=12.1 cudnn=8801 driver=546.33
2024-01-29 21:00:41,220 | sd | DEBUG | webui | Entering start sequence
2024-01-29 21:00:41,221 | sd | INFO | webui | Using data path: E:\AI\sdnext-rpg
2024-01-29 21:00:41,225 | sd | INFO | webui | Using models path: C:\Users\thoma\ai-common\models-diffusers
2024-01-29 21:00:41,272 | sd | DEBUG | webui | Initializing
2024-01-29 21:00:41,279 | sd | INFO | sd_vae | Available VAEs: path="C:\Users\thoma\ai-common\models-diffusers\VAE" items=3
2024-01-29 21:00:41,281 | sd | INFO | extensions | Disabled extensions: ['sd-webui-controlnet']
2024-01-29 21:00:41,289 | sd | DEBUG | modelloader | Scanning diffusers cache: C:\Users\thoma\ai-common\models-diffusers\Diffusers C:\Users\thoma\ai-common\models-diffusers\Diffusers items=3 time=0.00
2024-01-29 21:00:41,315 | sd | DEBUG | shared | Read: file="E:\AI\sdnext-rpg\cache.json" json=2 bytes=6743 time=0.018
2024-01-29 21:00:41,322 | sd | DEBUG | shared | Read: file="E:\AI\sdnext-rpg\metadata.json" json=68 bytes=155774 time=0.007
2024-01-29 21:00:41,351 | sd | INFO | sd_models | Available models: path="C:\Users\thoma\ai-common\models-diffusers\Stable-diffusion" items=14 time=0.07
2024-01-29 21:00:43,741 | sd | DEBUG | webui | Load extensions
2024-01-29 21:00:44,975 | sd | ERROR | faceid | FaceID: No module named 'insightface'
2024-01-29 21:00:44,978 | sd | INFO | script_loading | Extension: script='scripts\faceid.py' 21:00:44-975070 ERROR    FaceID: No module named 'insightface'
2024-01-29 21:00:48,388 | sd | INFO | script_loading | Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
2024-01-29 21:00:49,444 | sd | INFO | webui | Extensions time: 5.70 { sdnext=1.39 Lora=1.43 sd-extension-chainner=0.45 sd-extension-system-info=0.07 sd-webui-agent-scheduler=1.31 stable-diffusion-webui-images-browser=1.00 stable-diffusion-webui-rembg=0.06 }
2024-01-29 21:00:49,782 | sd | DEBUG | shared | Read: file="html/upscalers.json" json=4 bytes=2672 time=0.010
2024-01-29 21:00:49,791 | sd | DEBUG | shared | Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.007
2024-01-29 21:00:49,794 | sd | DEBUG | chainner_model | chaiNNer models: path="C:\Users\thoma\ai-common\models-diffusers\chaiNNer" defined=24 discovered=0 downloaded=5
2024-01-29 21:00:49,799 | sd | DEBUG | modelloader | Load upscalers: total=52 downloaded=9 user=0 time=0.35 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
2024-01-29 21:00:49,815 | sd | DEBUG | styles | Load styles: folder="C:\Users\thoma\ai-common\models-diffusers\styles" items=15 time=0.02
2024-01-29 21:00:49,875 | sd | DEBUG | webui | Creating UI
2024-01-29 21:00:49,875 | sd | INFO | theme | Load UI theme: name="black-teal" style=Auto base=sdnext.css
2024-01-29 21:00:50,005 | sd | DEBUG | shared | Read: file="html\reference.json" json=31 bytes=16496 time=0.011
2024-01-29 21:00:50,113 | sd | DEBUG | ui_extra_networks | Extra networks: page='model' items=45 subfolders=12 tab=txt2img folders=['C:\\Users\\thoma\\ai-common\\models-diffusers\\Stable-diffusion', 'C:\\Users\\thoma\\ai-common\\models-diffusers\\Diffusers', 'models\\Reference'] list=0.11 desc=0.02 info=0.07 workers=2
2024-01-29 21:00:50,119 | sd | DEBUG | ui_extra_networks | Extra networks: page='style' items=15 subfolders=4 tab=txt2img folders=['C:\\Users\\thoma\\ai-common\\models-diffusers\\styles', 'html'] list=0.00 desc=0.00 info=0.00 workers=2
2024-01-29 21:00:50,120 | sd | DEBUG | ui_extra_networks | Extra networks: page='embedding' items=2 subfolders=2 tab=txt2img folders=['C:\\Users\\thoma\\ai-common\\models-diffusers\\embeddings'] list=0.01 desc=0.00 info=0.00 workers=2
2024-01-29 21:00:50,123 | sd | DEBUG | ui_extra_networks | Extra networks: page='hypernetwork' items=0 subfolders=1 tab=txt2img folders=['C:\\Users\\thoma\\ai-common\\models-diffusers\\hypernetworks'] list=0.00 desc=0.00 info=0.00 workers=2
2024-01-29 21:00:50,125 | sd | DEBUG | ui_extra_networks | Extra networks: page='vae' items=3 subfolders=2 tab=txt2img folders=['C:\\Users\\thoma\\ai-common\\models-diffusers\\VAE'] list=0.00 desc=0.00 info=0.00 workers=2
2024-01-29 21:00:50,130 | sd | DEBUG | ui_extra_networks | Extra networks: page='lora' items=22 subfolders=8 tab=txt2img folders=['C:\\Users\\thoma\\ai-common\\models-diffusers\\Lora', 'C:\\Users\\thoma\\ai-common\\models-diffusers\\LyCORIS'] list=0.06 desc=0.00 info=0.07 workers=2
2024-01-29 21:00:51,236 | sd | DEBUG | ui_control | Control initialize: models=C:\Users\thoma\ai-common\models-diffusers\control
2024-01-29 21:00:51,606 | sd | DEBUG | shared | Read: file="E:\AI\sdnext-rpg\ui-config.json" json=13 bytes=437 time=0.000
2024-01-29 21:00:52,421 | sd | DEBUG | theme | Themes: builtin=9 default=5 external=55
2024-01-29 21:00:53,889 | sd | DEBUG | script_callbacks | Script: 1.35 ui_tabs E:\AI\sdnext\extensions-builtin\stable-diffusion-webui-images-browser\scripts\image_browser.py
2024-01-29 21:00:53,936 | sd | DEBUG | shared | Read: file="E:\AI\sdnext\html\extensions.json" json=333 bytes=195577 time=0.013
2024-01-29 21:00:54,666 | sd | DEBUG | ui_extensions | Extension list: processed=317 installed=7 enabled=6 disabled=1 visible=317 hidden=0
2024-01-29 21:00:59,319 | sd | INFO | webui | Local URL: http://localhost:7860/
2024-01-29 21:00:59,321 | sd | INFO | webui | API Docs: http://localhost:7860/docs
2024-01-29 21:00:59,322 | sd | DEBUG | webui | Gradio functions: registered=1960
2024-01-29 21:00:59,323 | sd | INFO | middleware | Initializing middleware
2024-01-29 21:00:59,345 | sd | DEBUG | webui | Creating API
2024-01-29 21:00:59,555 | sd | INFO | task_runner | [AgentScheduler] Task queue is empty
2024-01-29 21:00:59,556 | sd | INFO | api | [AgentScheduler] Registering APIs
2024-01-29 21:00:59,698 | sd | DEBUG | webui | Scripts setup: ['X/Y/Z Grid:0.007']
2024-01-29 21:00:59,698 | sd | DEBUG | sd_models | Model metadata: file="E:\AI\sdnext-rpg\metadata.json" no changes
2024-01-29 21:00:59,699 | sd | DEBUG | webui | Model auto load disabled
2024-01-29 21:00:59,700 | sd | DEBUG | shared | Save: file="E:\AI\sdnext-rpg\config.json" json=31 bytes=1515 time=0.001
2024-01-29 21:00:59,700 | sd | INFO | webui | Startup time: 81.61 { torch=28.56 gradio=5.89 diffusers=0.41 libraries=28.27 samplers=0.05 extensions=5.70 models=0.07 face-restore=2.39 upscalers=0.36 extra-networks=0.08 ui-extra-networks=1.27 ui-img2img=0.06 ui-control=0.05 ui-train=0.05 ui-interrogate=0.15 ui-settings=0.95 ui-extensions=2.16 ui-defaults=0.08 launch=4.58 api=0.13 app-started=0.23 }
2024-01-29 21:01:06,103 | sd | INFO | api | MOTD: N/A
2024-01-29 21:01:09,433 | sd | DEBUG | theme | Themes: builtin=9 default=5 external=55
2024-01-29 21:01:11,115 | sd | INFO | api | Browser session: user=None client=172.29.144.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:122.0) Gecko/20100101 Firefox/122.0
2024-01-29 21:01:59,755 | sd | DEBUG | launch | Server: alive=True jobs=0 requests=29 uptime=103 memory=1.09/15.95 backend=Backend.DIFFUSERS state=idle

Backend

Diffusers

Branch

Master

Model

SD-XL

Acknowledgements

vladmandic commented 5 months ago

for some reason, firefox completely ignores drop global event.

window.addEventListener('drop', (e) => { ... }

according to some articles, it apparently works if dragstart and dragover are initialized, but i don't want to do firefox-specific coding as it works fine as-is in chrome and chromium based browsers. i'm more and more dissapointed by firefox, number of missing or broken features is huge.

if someone wants to contribute, i'd welcome the pr, otherwise this is going to remain not working in firefox. fyi, code in question is in javascript/imageParams.js