search

vladmandic / automatic

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models
https://github.com/vladmandic/automatic
GNU Affero General Public License v3.0
5.36k stars 382 forks source link

[Feature]: New Segmind Model SSD-1B #2400

Closed xedis closed 9 months ago

xedis commented 9 months ago

Issue Description

Downloaded the model through the huggingface subtab of sdnext models tab

Gets onto the second part of loading the pipeline and breaks

(https://huggingface.co/segmind/SSD-1B)

2023-10-23 19:27:40,226 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/bebf961a8ceafc272909f9b0c235deadf579335f auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer

I selected other as the model, but technically this model leverages the SDXLPipeLine

Looks like diffusers 0.19.0, which i rolled back to and ran as experimental while crossing my fingers toes and eyes. No luck.

Version Platform Description

Kernel: 6.5.8-arch1-1 
Uptime: 1 day, 23 hours, 10 mins 
Packages: 1492 (pacman) 
Shell: bash 5.2.15 
Resolution: 1920x1080 @ 60.00Hz, 2560x1440 @ 164.85Hz 
DE: KDE 
WM: KWin 
Theme: [KDE], Adwaita [GTK2/3] 
Icons: [KDE], Adwaita [GTK2/3] 
Terminal: terminator 
CPU: AMD Ryzen 5 3600 (12) @ 3.6GHz [128.4°F] 
GPU: NVIDIA GeForce RTX 3060 
Memory: 27.35GiB / 125.72GiB (21%)

Relevant log output

2023-10-24 12:34:28,652 | sd | INFO | launch | Starting SD.Next
2023-10-24 12:34:28,668 | sd | INFO | installer | Version: app=sd.next updated=2023-10-24 hash=11834888 url=https://github.com/vladmandic/automatic.git/tree/master
2023-10-24 12:34:28,674 | sd | INFO | launch | Platform: arch=x86_64 cpu= system=Linux release=6.5.8-arch1-1 python=3.11.4
2023-10-24 12:34:28,675 | sd | DEBUG | installer | Setting environment tuning
2023-10-24 12:34:28,675 | sd | DEBUG | installer | Torch overrides: cuda=False rocm=False ipex=False diml=False openvino=False
2023-10-24 12:34:28,676 | sd | DEBUG | installer | Torch allowed: cuda=True rocm=True ipex=True diml=True openvino=True
2023-10-24 12:34:28,677 | sd | INFO | installer | nVidia CUDA toolkit detected: nvidia-smi present
2023-10-24 12:34:28,678 | sd | INFO | launch | No changes detected: quick launch active
2023-10-24 12:34:28,678 | sd | INFO | installer | Verifying requirements
2023-10-24 12:34:28,681 | sd | WARNING | installer | Package allowing experimental: diffusers 0.19.0 required 0.21.4
2023-10-24 12:34:28,682 | sd | INFO | installer | Verifying packages
2023-10-24 12:34:28,683 | sd | INFO | installer | Extensions: disabled=[]
2023-10-24 12:34:28,683 | sd | INFO | installer | Extensions: enabled=['clip-interrogator-ext', 'sd-extension-system-info', 'sd-webui-controlnet', 'sd-webui-agent-scheduler', 'stable-diffusion-webui-rembg', 'stable-diffusion-webui-images-browser', 'Lora', 'sd-extension-chainner'] extensions-builtin
2023-10-24 12:34:28,685 | sd | INFO | installer | Extensions: enabled=['sd-webui-aspect-ratio-helper', 'sd-webui-supermerger', 'sd_civitai_extension', 'sd-extension-nudenet', 'deforum-for-automatic1111-webui', 'sd-webui-animatediff', 'stable-diffusion-webui-wildcards', 'sd-webui-infinite-image-browsing'] extensions
2023-10-24 12:34:28,689 | sd | INFO | installer | Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0}
2023-10-24 12:34:28,690 | sd | DEBUG | launch | Starting module: <module 'webui' from '/home/vlad/onemoretime/main/webui.py'>
2023-10-24 12:34:28,690 | sd | INFO | launch | Command line args: ['--debug', '--listen', '--insecure', '--config', 'config-1.json', '--quick', '--experimental'] config=config-1.json insecure=True listen=True debug=True quick=True experimental=True
2023-10-24 12:34:33,716 | sd | DEBUG | loader | Loaded packages: torch=2.1.0+cu121 diffusers=0.19.0 gradio=3.43.2
2023-10-24 12:34:33,964 | sd | DEBUG | shared | Reading: config-1.json len=63
2023-10-24 12:34:33,965 | sd | DEBUG | shared | Unknown settings: ['arh_javascript_aspect_ratio', 'civitai_link_key', 'animatediff_model_path', 'animatediff_xformers', 'control_net_allow_script_control', 'control_net_model_cache_size', 'animatediff_optimize_gif_palette']
2023-10-24 12:34:33,966 | sd | INFO | shared | Engine: backend=Backend.DIFFUSERS compute=cuda mode=no_grad device=cuda cross-optimization="Disabled"
2023-10-24 12:34:34,003 | sd | INFO | shared | Device: device=NVIDIA GeForce RTX 3060 n=1 arch=sm_90 cap=(8, 6) cuda=12.1 cudnn=8902 driver=535.113.01
2023-10-24 12:34:34,499 | sd | DEBUG | webui | Entering start sequence
2023-10-24 12:34:34,501 | sd | DEBUG | webui | Initializing
2023-10-24 12:34:34,508 | sd | INFO | sd_vae | Available VAEs: path="models/VAE" items=8
2023-10-24 12:34:34,508 | sd | INFO | shared | Diffusers disabling uncompatible extensions: ['sd-webui-controlnet', 'multidiffusion-upscaler-for-automatic1111', 'a1111-sd-webui-lycoris']
2023-10-24 12:34:34,516 | sd | DEBUG | modelloader | Scanning diffusers cache: models/Diffusers models/Diffusers items=17 time=0.00s
2023-10-24 12:34:34,522 | sd | DEBUG | shared | Reading: cache.json len=2
2023-10-24 12:34:34,629 | sd | DEBUG | shared | Reading: metadata.json len=4503
2023-10-24 12:34:34,639 | sd | INFO | sd_models | Available models: path="models/Stable-diffusion" items=504 time=0.13s
2023-10-24 12:34:34,768 | sd | DEBUG | webui | Loading extensions
2023-10-24 12:34:35,930 | sd | INFO | script_loading | Extension: script='extensions-builtin/sd-webui-agent-scheduler/scripts/task_scheduler.py' Using sqlite file: extensions-builtin/sd-webui-agent-scheduler/task_scheduler.sqlite3
2023-10-24 12:34:37,480 | sd | INFO | script_loading | Extension: script='extensions/sd_civitai_extension/scripts/api.py' Civitai: API loaded
2023-10-24 12:34:37,954 | sd | INFO | webui | Extensions time: 3.18s { clip-interrogator-ext=0.35s Lora=0.33s sd-extension-chainner=0.07s sd-extension-system-info=0.05s sd-webui-agent-scheduler=0.35s stable-diffusion-webui-images-browser=0.11s stable-diffusion-webui-rembg=0.38s deforum-for-automatic1111-webui=0.13s sd-webui-animatediff=0.12s sd-webui-aspect-ratio-helper=0.14s sd-webui-infinite-image-browsing=0.40s sd-webui-supermerger=0.19s sd_civitai_extension=0.48s stable-diffusion-webui-wildcards=0.06s }
2023-10-24 12:34:38,092 | sd | DEBUG | shared | Reading: html/upscalers.json len=4
2023-10-24 12:34:38,094 | sd | DEBUG | modelloader | Loaded upscalers: total=62 downloaded=43 user=19 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'SD', 'SwinIR', 'RealESRGAN', 'SCUNet', 'LDSR', 'ESRGAN']
2023-10-24 12:34:38,118 | sd | DEBUG | styles | Loaded styles: folder=models/styles items=289
2023-10-24 12:34:38,120 | sd | DEBUG | webui | Creating UI
2023-10-24 12:34:38,183 | sd | INFO | theme | No internet access detected, using default fonts
2023-10-24 12:34:38,184 | sd | INFO | theme | Loading UI theme: name=black-teal style=Auto base=style.css
2023-10-24 12:34:39,501 | sd | DEBUG | ui_extra_networks | Extra networks: page='model' items=504 subdirs=18 tab=txt2img dirs=['models/Stable-diffusion', 'models/Diffusers', '/home/vlad/onemoretime/main/models/Stable-diffusion'] time=0.49s
2023-10-24 12:34:39,549 | sd | DEBUG | ui_extra_networks | Extra networks: page='style' items=288 subdirs=3 tab=txt2img dirs=['models/styles', 'html'] time=0.0s
2023-10-24 12:34:39,567 | sd | DEBUG | ui_extra_networks | Extra networks: page='embedding' items=461 subdirs=6 tab=txt2img dirs=['models/embeddings'] time=0.51s
2023-10-24 12:34:39,573 | sd | DEBUG | ui_extra_networks | Extra networks: page='hypernetwork' items=10 subdirs=4 tab=txt2img dirs=['models/hypernetworks'] time=0.01s
2023-10-24 12:34:39,579 | sd | DEBUG | ui_extra_networks | Extra networks: page='vae' items=8 subdirs=15 tab=txt2img dirs=['models/VAE'] time=0.01s
2023-10-24 12:34:39,655 | sd | DEBUG | ui_extra_networks | Extra networks: page='lora' items=3025 subdirs=18 tab=txt2img dirs=['models/Lora', 'models/LyCORIS'] time=1.27s
2023-10-24 12:34:39,808 | sd | DEBUG | shared | Reading: ui-config.json len=0
2023-10-24 12:34:39,840 | sd | DEBUG | theme | Themes: builtin=6 default=5 external=55
2023-10-24 12:34:39,989 | sd | WARNING | ui_extra_networks | Extra network removing invalid image: models/Lora/xxx/NsfwPovAllInOneLoraSdxl-000009.preview.png
2023-10-24 12:34:40,403 | sd | DEBUG | script_callbacks | Script: 0.46s ui_tabs /home/vlad/onemoretime/main/extensions-builtin/stable-diffusion-webui-images-browser/scripts/image_browser.py
2023-10-24 12:34:40,507 | sd | DEBUG | shared | Reading: /home/vlad/onemoretime/main/html/extensions.json len=312
2023-10-24 12:34:40,630 | sd | DEBUG | ui_extensions | Extension list: processed=297 installed=16 enabled=15 disabled=1 visible=297 hidden=0
2023-10-24 12:34:41,422 | sd | INFO | webui | Local URL: http://localhost:7860/
2023-10-24 12:34:41,423 | sd | DEBUG | webui | Gradio registered functions: 1870
2023-10-24 12:34:41,423 | sd | INFO | middleware | Initializing middleware
2023-10-24 12:34:41,426 | sd | DEBUG | webui | Creating API
2023-10-24 12:34:41,581 | sd | INFO | task_runner | [AgentScheduler] Task queue is empty
2023-10-24 12:34:41,582 | sd | INFO | api | [AgentScheduler] Registering APIs
2023-10-24 12:34:41,937 | sd | DEBUG | script_callbacks | Script: 0.28s app_started /home/vlad/onemoretime/main/extensions/sd_civitai_extension/scripts/link.py
2023-10-24 12:34:42,037 | sd | DEBUG | webui | Scripts setup: ['X/Y/Z Grid:0.005s', 'AnimateDiff:0.005s']
2023-10-24 12:34:42,040 | sd | DEBUG | sd_models | Model metadata: metadata.json no changes
2023-10-24 12:34:42,042 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:34:42,043 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:34:42,044 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=False no-half-vae=False upscast=False
2023-10-24 12:34:42,045 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.bfloat16 vae=torch.bfloat16 unet=torch.bfloat16 context=inference_mode fp16=False bf16=True
2023-10-24 12:34:45,714 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:34:45,716 | sd | DEBUG | shared | Saving: config-1.json len=2828
2023-10-24 12:34:45,717 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:34:45,718 | sd | INFO | webui | Startup time: 17.00s { torch=4.42s gradio=0.31s diffusers=0.28s libraries=0.78s extensions=3.18s models=0.13s face-restore=0.13s upscalers=0.14s ui-extra-networks=1.54s ui-img2img=0.06s ui-settings=0.11s ui-extensions=0.74s ui-defaults=0.07s launch=0.71s api=0.07s app-started=0.55s checkpoint=3.68s }
2023-10-24 12:35:59,729 | sd | DEBUG | launch | Server alive=True jobs=1 requests=18 uptime=86s memory used=12.25 total=125.72 job="load model" 0/-1
2023-10-24 12:37:15,422 | sd | INFO | api | MOTD: N/A
2023-10-24 12:37:20,942 | sd | DEBUG | theme | Themes: builtin=6 default=5 external=55
2023-10-24 12:37:27,563 | sd | INFO | api | Browser session: client=127.0.0.1 agent=Mozilla/5.0 (X11; Linux x86_64; rv:109.0) Gecko/20100101 Firefox/118.0
2023-10-24 12:37:59,756 | sd | DEBUG | launch | Server alive=True jobs=1 requests=83 uptime=206s memory used=12.27 total=125.72 job="load model" 0/-1
2023-10-24 12:39:59,768 | sd | DEBUG | launch | Server alive=True jobs=1 requests=131 uptime=326s memory used=12.27 total=125.72 job="load model" 0/-1
2023-10-24 12:40:38,240 | sd | DEBUG | devices | gc: collected=40404 device=cuda {'ram': {'used': 5.06, 'total': 125.72}, 'gpu': {'used': 2.22, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:40:38,591 | sd | DEBUG | devices | gc: collected=341 device=cuda {'ram': {'used': 5.06, 'total': 125.72}, 'gpu': {'used': 2.22, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:40:39,903 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:40:39,905 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:40:39,906 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=False no-half-vae=False upscast=False
2023-10-24 12:40:39,907 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.bfloat16 vae=torch.bfloat16 unet=torch.bfloat16 context=inference_mode fp16=False bf16=True
2023-10-24 12:40:43,529 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:40:57,537 | sd | DEBUG | shared | Saving: config-1.json len=2834
2023-10-24 12:40:57,539 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:40:57,539 | sd | DEBUG | ui | Setting changed: key=diffusers_pipeline, value=Custom Diffusers Pipeline
2023-10-24 12:41:00,773 | sd | DEBUG | devices | gc: collected=39638 device=cuda {'ram': {'used': 8.36, 'total': 125.72}, 'gpu': {'used': 2.22, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:41:01,142 | sd | DEBUG | devices | gc: collected=248 device=cuda {'ram': {'used': 8.36, 'total': 125.72}, 'gpu': {'used': 2.23, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:41:02,509 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:41:02,510 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:41:02,511 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=False no-half-vae=False upscast=False
2023-10-24 12:41:02,512 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.bfloat16 vae=torch.bfloat16 unet=torch.bfloat16 context=inference_mode fp16=False bf16=True
2023-10-24 12:41:03,526 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:41:09,849 | sd | DEBUG | shared | Saving: config-1.json len=2834
2023-10-24 12:41:09,850 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:41:09,851 | sd | DEBUG | ui | Setting changed: key=cuda_dtype, value=FP32
2023-10-24 12:41:12,308 | sd | DEBUG | devices | gc: collected=3454 device=cuda {'ram': {'used': 8.36, 'total': 125.72}, 'gpu': {'used': 2.23, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:41:12,668 | sd | DEBUG | devices | gc: collected=377 device=cuda {'ram': {'used': 8.36, 'total': 125.72}, 'gpu': {'used': 2.25, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:41:14,216 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:41:14,218 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:41:14,219 | sd | DEBUG | devices | Desired Torch parameters: dtype=FP32 no-half=False no-half-vae=False upscast=False
2023-10-24 12:41:14,220 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=False
2023-10-24 12:41:14,970 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:42:00,310 | sd | DEBUG | launch | Server alive=True jobs=1 requests=179 uptime=446s memory used=8.36 total=125.72 job="load model" 0/-1
2023-10-24 12:44:00,321 | sd | DEBUG | launch | Server alive=True jobs=1 requests=227 uptime=566s memory used=8.36 total=125.72 job="load model" 0/-1
2023-10-24 12:46:00,332 | sd | DEBUG | launch | Server alive=True jobs=1 requests=275 uptime=686s memory used=8.36 total=125.72 job="load model" 0/-1
2023-10-24 12:48:00,345 | sd | DEBUG | launch | Server alive=True jobs=1 requests=323 uptime=806s memory used=8.36 total=125.72 job="load model" 0/-1
2023-10-24 12:48:09,054 | sd | DEBUG | shared | Saving: config-1.json len=2876
2023-10-24 12:48:09,057 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:48:09,058 | sd | INFO | ui | Settings: changed=2 ['no_half', 'no_half_vae']
2023-10-24 12:48:10,130 | sd | DEBUG | shared | Saving: config-1.json len=2876
2023-10-24 12:48:10,131 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:48:13,683 | sd | DEBUG | devices | gc: collected=937 device=cuda {'ram': {'used': 8.36, 'total': 125.72}, 'gpu': {'used': 2.5, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:48:14,077 | sd | DEBUG | devices | gc: collected=171 device=cuda {'ram': {'used': 8.36, 'total': 125.72}, 'gpu': {'used': 2.5, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:48:14,974 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:48:14,976 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:48:14,977 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:48:14,977 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:48:14,978 | sd | DEBUG | devices | Desired Torch parameters: dtype=FP32 no-half=True no-half-vae=True upscast=False
2023-10-24 12:48:14,978 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=False
2023-10-24 12:48:15,735 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:48:45,694 | sd | DEBUG | modelloader | Scanning diffusers cache: models/Diffusers models/Diffusers items=18 time=0.00s
2023-10-24 12:48:45,709 | sd | INFO | sd_models | Available models: path="models/Stable-diffusion" items=505 time=0.02s
2023-10-24 12:48:45,711 | sd | INFO | ui_models | Diffuser model downloaded: model=""
2023-10-24 12:48:59,370 | sd | DEBUG | modelloader | Diffusers downloading: segmind/SSD-1B {'force_download': False, 'resume_download': True, 'cache_dir': 'models/Diffusers', 'load_connected_pipeline': True, 'variant': 'fp32'}
2023-10-24 12:48:59,705 | sd | DEBUG | shared | Saving: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a/model_info.json len=316
2023-10-24 12:48:59,712 | sd | DEBUG | modelloader | Scanning diffusers cache: models/Diffusers models/Diffusers items=18 time=0.00s
2023-10-24 12:48:59,732 | sd | INFO | sd_models | Available models: path="models/Stable-diffusion" items=505 time=0.02s
2023-10-24 12:48:59,734 | sd | INFO | ui_models | Diffuser model downloaded: model="segmind/SSD-1B"
2023-10-24 12:49:15,523 | sd | DEBUG | devices | gc: collected=4203 device=cuda {'ram': {'used': 8.35, 'total': 125.72}, 'gpu': {'used': 2.51, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:49:15,895 | sd | DEBUG | devices | gc: collected=248 device=cuda {'ram': {'used': 8.35, 'total': 125.72}, 'gpu': {'used': 2.51, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:49:17,655 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:49:17,657 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:49:17,658 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:49:17,658 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:49:17,659 | sd | DEBUG | devices | Desired Torch parameters: dtype=FP32 no-half=True no-half-vae=True upscast=False
2023-10-24 12:49:17,660 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=False
2023-10-24 12:49:18,564 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:49:26,925 | sd | DEBUG | shared | Saving: config-1.json len=2900
2023-10-24 12:49:26,926 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:49:26,927 | sd | INFO | ui | Settings: changed=1 ['cuda_compile']
2023-10-24 12:49:33,388 | sd | DEBUG | devices | gc: collected=3824 device=cuda {'ram': {'used': 8.35, 'total': 125.72}, 'gpu': {'used': 2.51, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:49:33,735 | sd | DEBUG | devices | gc: collected=248 device=cuda {'ram': {'used': 8.35, 'total': 125.72}, 'gpu': {'used': 2.51, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:49:34,353 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:49:34,355 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:49:34,356 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:49:34,356 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:49:34,357 | sd | DEBUG | devices | Desired Torch parameters: dtype=FP32 no-half=True no-half-vae=True upscast=False
2023-10-24 12:49:34,358 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=False
2023-10-24 12:49:35,057 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:49:45,692 | sd | DEBUG | shared | Saving: config-1.json len=2900
2023-10-24 12:49:45,694 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:49:45,696 | sd | DEBUG | ui | Setting changed: key=cuda_dtype, value=BF16
2023-10-24 12:49:51,833 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:49:51,835 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:49:51,836 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:49:51,837 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:49:51,838 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=True no-half-vae=True upscast=False
2023-10-24 12:49:51,839 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=True
2023-10-24 12:49:52,839 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:49:52,842 | sd | DEBUG | shared | Saving: config-1.json len=2880
2023-10-24 12:49:52,846 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:49:52,847 | sd | DEBUG | ui | Setting changed: key=sd_vae, value=Automatic
2023-10-24 12:49:59,899 | sd | DEBUG | launch | Server alive=True jobs=1 requests=371 uptime=926s memory used=8.35 total=125.72 job="load model" 0/-1
2023-10-24 12:50:01,041 | sd | DEBUG | shared | Saving: config-1.json len=2880
2023-10-24 12:50:01,043 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:50:02,685 | sd | DEBUG | devices | gc: collected=3670 device=cuda {'ram': {'used': 8.35, 'total': 125.72}, 'gpu': {'used': 2.48, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:03,037 | sd | DEBUG | devices | gc: collected=292 device=cuda {'ram': {'used': 8.35, 'total': 125.72}, 'gpu': {'used': 2.48, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:03,869 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:50:03,870 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:50:03,871 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:50:03,872 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:50:03,872 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=True no-half-vae=True upscast=False
2023-10-24 12:50:03,873 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=True
2023-10-24 12:50:04,544 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:50:12,545 | sd | DEBUG | shared | Saving: config-1.json len=2874
2023-10-24 12:50:12,547 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:50:12,547 | sd | DEBUG | ui | Setting changed: key=diffusers_pipeline, value=Stable Diffusion XL
2023-10-24 12:50:15,126 | sd | DEBUG | devices | gc: collected=3578 device=cuda {'ram': {'used': 8.35, 'total': 125.72}, 'gpu': {'used': 2.49, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:15,491 | sd | DEBUG | devices | gc: collected=248 device=cuda {'ram': {'used': 8.35, 'total': 125.72}, 'gpu': {'used': 2.48, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:15,885 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:50:15,887 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:50:15,888 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:50:15,889 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:50:15,889 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=True no-half-vae=True upscast=False
2023-10-24 12:50:15,890 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=True
2023-10-24 12:50:18,324 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:50:26,377 | sd | DEBUG | shared | Saving: config-1.json len=2883
2023-10-24 12:50:26,378 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:50:26,379 | sd | DEBUG | ui | Setting changed: key=diffusers_pipeline, value=Stable Diffusion XL Instruct
2023-10-24 12:50:29,106 | sd | DEBUG | devices | gc: collected=39609 device=cuda {'ram': {'used': 8.4, 'total': 125.72}, 'gpu': {'used': 2.49, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:29,465 | sd | DEBUG | devices | gc: collected=292 device=cuda {'ram': {'used': 8.4, 'total': 125.72}, 'gpu': {'used': 2.48, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:31,278 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:50:31,280 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:50:31,281 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:50:31,281 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:50:31,282 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=True no-half-vae=True upscast=False
2023-10-24 12:50:31,283 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=True
2023-10-24 12:50:33,771 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:50:44,385 | sd | DEBUG | shared | Saving: config-1.json len=2882
2023-10-24 12:50:44,386 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:50:44,387 | sd | DEBUG | ui | Setting changed: key=diffusers_pipeline, value=Stable Diffusion XL Img2Img
2023-10-24 12:50:46,558 | sd | DEBUG | devices | gc: collected=39592 device=cuda {'ram': {'used': 8.41, 'total': 125.72}, 'gpu': {'used': 2.48, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:46,908 | sd | DEBUG | devices | gc: collected=248 device=cuda {'ram': {'used': 8.41, 'total': 125.72}, 'gpu': {'used': 2.48, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:47,630 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:50:47,631 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:50:47,633 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:50:47,634 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:50:47,635 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=True no-half-vae=True upscast=False
2023-10-24 12:50:47,636 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=True
2023-10-24 12:50:50,056 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:50:56,330 | sd | DEBUG | shared | Saving: config-1.json len=2874
2023-10-24 12:50:56,333 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:50:56,334 | sd | DEBUG | ui | Setting changed: key=diffusers_pipeline, value=Stable Diffusion XL
2023-10-24 12:50:59,000 | sd | DEBUG | devices | gc: collected=39514 device=cuda {'ram': {'used': 8.41, 'total': 125.72}, 'gpu': {'used': 2.5, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:50:59,375 | sd | DEBUG | devices | gc: collected=292 device=cuda {'ram': {'used': 8.41, 'total': 125.72}, 'gpu': {'used': 2.5, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:51:00,469 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:51:00,470 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:51:00,471 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:51:00,472 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:51:00,472 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=True no-half-vae=True upscast=False
2023-10-24 12:51:00,473 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=True
2023-10-24 12:51:02,919 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer
2023-10-24 12:51:18,402 | sd | DEBUG | shared | Saving: config-1.json len=2827
2023-10-24 12:51:18,404 | sd | DEBUG | shared | Unused settings: ['control_net_allow_script_control', 'control_net_model_cache_size']
2023-10-24 12:51:18,405 | sd | DEBUG | ui | Setting changed: key=diffusers_pipeline, value=Autodetect
2023-10-24 12:51:20,696 | sd | DEBUG | devices | gc: collected=39670 device=cuda {'ram': {'used': 8.42, 'total': 125.72}, 'gpu': {'used': 2.48, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:51:21,074 | sd | DEBUG | devices | gc: collected=248 device=cuda {'ram': {'used': 8.42, 'total': 125.72}, 'gpu': {'used': 2.48, 'total': 11.76}, 'retries': 0, 'oom': 0}
2023-10-24 12:51:21,860 | sd | INFO | sd_models | Select: model="Diffusers/segmind/SSD-1B [ba12b1245d]"
2023-10-24 12:51:21,862 | sd | DEBUG | sd_models | Load model weights: existing=False target=models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a info=None
2023-10-24 12:51:21,863 | sd | INFO | devices | Torch override dtype: no-half set
2023-10-24 12:51:21,864 | sd | INFO | devices | Torch override VAE dtype: no-half set
2023-10-24 12:51:21,865 | sd | DEBUG | devices | Desired Torch parameters: dtype=BF16 no-half=True no-half-vae=True upscast=False
2023-10-24 12:51:21,866 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float32 vae=torch.float32 unet=torch.float32 context=inference_mode fp16=False bf16=True
2023-10-24 12:51:24,392 | sd | ERROR | sd_models | Failed loading model: models/Diffusers/models--segmind--SSD-1B/snapshots/ba12b1245d83ffa7aa22bfcfaaad1e969a49932a auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be interpreted as an integer

Backend

Diffusers

Model

Other

Acknowledgements

vladmandic commented 9 months ago

how about reclassifying this as feature request? this model is brand new.

vladmandic commented 9 months ago

done in dev.

rabidcopy commented 9 months ago

Edit: Turns out I needed to install the latest Diffusers from source.

~~Well, this is odd. Was able to load the model on Windows with DirectML. But get this on Linux with ROCM.~~

23:23:43-328777 INFO     Select: model="Diffusers/segmind/SSD-1B [8277feca68]"                                           
23:23:43-625273 INFO     Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16 unet=torch.float16  
                         context=no_grad fp16=True bf16=False                                                            
Loading pipeline components...:  71%|██████████████████████████████████████▌               | 5/7 [00:00<00:00, 10.56it/s]
Loading pipeline components...:  71%|██████████████████████████████████████▌               | 5/7 [00:00<00:00, 10.89it/s]
Loading pipeline components...:  80%|███████████████████████████████████████████▏          | 4/5 [00:00<00:00,  9.53it/s]
23:23:44-982852 ERROR    Failed loading model:                                                                           
                         models/Diffusers/models--segmind--SSD-1B/snapshots/8277feca682bcb0b42c8244b89776614389f8935     
                         auto='list' object cannot be interpreted as an integer diffusion='list' object cannot be        
                         interpreted as an integer