vladmandic / automatic

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models
https://github.com/vladmandic/automatic
GNU Affero General Public License v3.0
5.51k stars 402 forks source link

[Issue]: ROCm diffusers/utils/import_utils.py:830 in _get_module #3434

Open grigio opened 5 days ago

grigio commented 5 days ago

Issue Description

I tried to run ./webui.sh --use-rocm on Linux

Version Platform Description

No response

Relevant log output

$ ./webui.sh --use-rocm
Activate python venv: /mnt/exwin/esperimenti/automatic/venv
Launch: venv/bin/python3
09:14:27-543557 INFO     Starting SD.Next                                                                                                                     
09:14:27-544853 INFO     Logger: file="/mnt/exwin/esperimenti/automatic/sdnext.log" level=INFO size=6791 mode=append                                          
09:14:27-545373 INFO     Python version=3.11.2 platform=Linux bin="/mnt/exwin/esperimenti/automatic/venv/bin/python3"                                         
                         venv="/mnt/exwin/esperimenti/automatic/venv"                                                                                         
09:14:27-554295 INFO     Version: app=sd.next updated=2024-09-13 hash=e7ec07f9 branch=master url=https://github.com/vladmandic/automatic/tree/master ui=main  
09:14:28-102979 INFO     Platform: arch=x86_64 cpu= system=Linux release=6.1.0-25-amd64 python=3.11.2                                                         
09:14:28-104203 INFO     HF cache folder: /home/g/.cache/huggingface/hub                                                                                      
09:14:28-109697 INFO     Using CPU-only Torch                                                                                                                 
09:14:41-589994 INFO     Verifying requirements                                                                                                               
09:14:41-591215 WARNING  Package version mismatch: setuptools 66.1.1 required 69.5.1                                                                          
09:14:41-591941 INFO     Install: package="setuptools==69.5.1" mode=pip                                                                                       
09:14:43-171013 INFO     Install: package="patch-ng" mode=pip                                                                                                 
09:14:44-262094 INFO     Install: package="anyio" mode=pip                                                                                                    
09:14:45-276434 INFO     Install: package="addict" mode=pip                                                                                                   
09:14:46-208129 INFO     Install: package="astunparse" mode=pip                                                                                               
09:14:47-242359 INFO     Install: package="clean-fid" mode=pip                                                                                                
09:14:48-403315 INFO     Install: package="filetype" mode=pip                                                                                                 
09:14:49-336806 INFO     Install: package="future" mode=pip                                                                                                   
09:14:50-347226 INFO     Install: package="GitPython" mode=pip                                                                                                
09:14:51-531134 INFO     Install: package="httpcore" mode=pip                                                                                                 
09:14:52-627948 INFO     Install: package="inflection" mode=pip                                                                                               
09:14:53-580173 INFO     Install: package="jsonmerge" mode=pip                                                                                                
09:14:54-525117 INFO     Install: package="kornia" mode=pip                                                                                                   
09:14:56-092176 INFO     Install: package="lark" mode=pip                                                                                                     
09:14:57-125486 INFO     Install: package="lpips" mode=pip                                                                                                    
09:14:58-309916 INFO     Install: package="omegaconf" mode=pip                                                                                                
09:14:59-776885 INFO     Install: package="optimum" mode=pip                                                                                                  
09:15:17-484344 INFO     Install: package="piexif" mode=pip                                                                                                   
09:15:18-606189 INFO     Install: package="resize-right" mode=pip                                                                                             
09:15:19-720680 INFO     Install: package="toml" mode=pip                                                                                                     
09:15:20-833637 INFO     Install: package="voluptuous" mode=pip                                                                                               
09:15:21-991050 INFO     Install: package="yapf" mode=pip                                                                                                     
09:15:23-851151 INFO     Install: package="fasteners" mode=pip                                                                                                
09:15:24-921034 INFO     Install: package="orjson" mode=pip                                                                                                   
09:15:26-256151 INFO     Install: package="invisible-watermark" mode=pip                                                                                      
09:15:28-862973 INFO     Install: package="pi-heif" mode=pip                                                                                                  
09:15:30-091101 INFO     Install: package="tensordict==0.1.2" mode=pip                                                                                        
09:15:31-612657 INFO     Install: package="peft==0.11.1" mode=pip                                                                                             
09:15:34-196966 INFO     Install: package="httpx==0.24.1" mode=pip                                                                                            
09:15:35-556098 INFO     Install: package="compel==2.0.2" mode=pip                                                                                            
09:15:37-236308 INFO     Install: package="torchsde==0.2.6" mode=pip                                                                                          
09:15:38-933815 INFO     Install: package="open-clip-torch" mode=pip                                                                                          
09:15:42-028256 INFO     Install: package="clip-interrogator==0.6.0" mode=pip                                                                                 
09:15:43-892799 WARNING  Package version mismatch: requests 2.32.3 required 2.31.0                                                                            
09:15:43-893686 INFO     Install: package="requests==2.31.0" mode=pip                                                                                         
09:15:45-128489 WARNING  Package version mismatch: tqdm 4.66.5 required 4.66.4                                                                                
09:15:45-129375 INFO     Install: package="tqdm==4.66.4" mode=pip                                                                                             
09:15:46-368317 INFO     Install: package="opencv-contrib-python-headless==4.9.0.80" mode=pip                                                                 
09:15:48-300736 INFO     Install: package="einops==0.4.1" mode=pip                                                                                            
09:15:49-595285 INFO     Install: package="gradio==3.43.2" mode=pip                                                                                           
09:15:59-078815 WARNING  Package version mismatch: huggingface_hub 0.24.7 required 0.24.6                                                                     
09:15:59-079680 INFO     Install: package="huggingface_hub==0.24.6" mode=pip                                                                                  
09:16:00-563151 INFO     Install: package="numexpr==2.8.8" mode=pip                                                                                           
09:16:01-977317 INFO     Install: package="numba==0.59.1" mode=pip                                                                                            
09:16:04-853699 INFO     Install: package="blendmodes" mode=pip                                                                                               
09:16:06-454604 WARNING  Package version mismatch: protobuf 5.28.0 required 4.25.3                                                                            
09:16:06-455603 INFO     Install: package="protobuf==4.25.3" mode=pip                                                                                         
09:16:08-182773 INFO     Install: package="pytorch_lightning==1.9.4" mode=pip                                                                                 
09:16:11-890883 WARNING  Package version mismatch: urllib3 2.2.2 required 1.26.19                                                                             
09:16:11-892044 INFO     Install: package="urllib3==1.26.19" mode=pip                                                                                         
09:16:13-318158 WARNING  Package version mismatch: timm 1.0.9 required 0.9.16                                                                                 
09:16:13-318713 INFO     Install: package="timm==0.9.16" mode=pip                                                                                             
09:16:15-259637 WARNING  Package version mismatch: pydantic 2.9.1 required 1.10.15                                                                            
09:16:15-260221 INFO     Install: package="pydantic==1.10.15" mode=pip                                                                                        
09:16:16-800027 WARNING  Package version mismatch: typing-extensions 4.12.2 required 4.11.0                                                                   
09:16:16-800916 INFO     Install: package="typing-extensions==4.11.0" mode=pip                                                                                
09:16:18-285509 INFO     Install: package="torchdiffeq" mode=pip                                                                                              
09:16:19-857268 INFO     Install: package="dctorch" mode=pip                                                                                                  
09:16:21-457787 INFO     Install: package="scikit-image" mode=pip                                                                                             
09:16:23-843537 INFO     Install: package="seam-carving" mode=pip                                                                                             
09:16:25-662873 INFO     Verifying packages                                                                                                                   
09:16:25-663661 INFO     Install: package="git+https://github.com/openai/CLIP.git" mode=pip                                                                   
09:16:30-453990 INFO     Startup: standard                                                                                                                    
09:16:30-454601 INFO     Verifying submodules                                                                                                                 
09:17:16-281290 INFO     Extension installed packages: sd-webui-agent-scheduler ['SQLAlchemy==2.0.34', 'greenlet==3.1.0']                                     
09:17:32-471943 INFO     Extension installed packages: stable-diffusion-webui-rembg ['PyMatting==1.1.12', 'opencv-python-headless==4.10.0.84', 'pooch==1.8.2',
                         'rembg==2.0.59']                                                                                                                     
09:17:32-472687 INFO     Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui',     
                         'stable-diffusion-webui-rembg']                                                                                                      
09:17:32-473126 INFO     Verifying requirements                                                                                                               
09:17:32-474875 INFO     Command line args: ['--use-rocm'] use_rocm=True                                                                                      
╭──────────────────────────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────────────────────────╮
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:830 in _get_module                                      │
│                                                                                                                                                            │
│   829         try:                                                                                                                                         │
│ ❱ 830             return importlib.import_module("." + module_name, self.__name__)                                                                         │
│   831         except Exception as e:                                                                                                                       │
│                                                                                                                                                            │
│ /usr/lib/python3.11/importlib/__init__.py:126 in import_module                                                                                             │
│                                                                                                                                                            │
│   125             level += 1                                                                                                                               │
│ ❱ 126     return _bootstrap._gcd_import(name[level:], package, level)                                                                                      │
│   127                                                                                                                                                      │
│ in _gcd_import:1206                                                                                                                                        │
│ in _find_and_load:1178                                                                                                                                     │
│ in _find_and_load_unlocked:1149                                                                                                                            │
│ in _load_unlocked:690                                                                                                                                      │
│ in exec_module:940                                                                                                                                         │
│ in _call_with_frames_removed:241                                                                                                                           │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/loaders/unet.py:46 in <module>                                                │
│                                                                                                                                                            │
│    45 )                                                                                                                                                    │
│ ❱  46 from .lora_pipeline import LORA_WEIGHT_NAME, LORA_WEIGHT_NAME_SAFE, TEXT_ENCODER_NAME, UNET_NAME                                                     │
│    47 from .utils import AttnProcsLayers                                                                                                                   │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/loaders/lora_pipeline.py:33 in <module>                                       │
│                                                                                                                                                            │
│     32 )                                                                                                                                                   │
│ ❱   33 from .lora_base import LoraBaseMixin                                                                                                                │
│     34 from .lora_conversion_utils import (                                                                                                                │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/loaders/lora_base.py:47 in <module>                                           │
│                                                                                                                                                            │
│    46 if is_peft_available():                                                                                                                              │
│ ❱  47     from peft.tuners.tuners_utils import BaseTunerLayer                                                                                              │
│    48                                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/peft/__init__.py:22 in <module>                                                         │
│                                                                                                                                                            │
│   21                                                                                                                                                       │
│ ❱ 22 from .auto import (                                                                                                                                   │
│   23     AutoPeftModel,                                                                                                                                    │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/peft/auto.py:32 in <module>                                                             │
│                                                                                                                                                            │
│    31 from .config import PeftConfig                                                                                                                       │
│ ❱  32 from .mapping import MODEL_TYPE_TO_PEFT_MODEL_MAPPING                                                                                                │
│    33 from .peft_model import (                                                                                                                            │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/peft/mapping.py:22 in <module>                                                          │
│                                                                                                                                                            │
│    21 from .config import PeftConfig                                                                                                                       │
│ ❱  22 from .mixed_model import PeftMixedModel                                                                                                              │
│    23 from .peft_model import (                                                                                                                            │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/peft/mixed_model.py:26 in <module>                                                      │
│                                                                                                                                                            │
│    25                                                                                                                                                      │
│ ❱  26 from peft.tuners.mixed import COMPATIBLE_TUNER_TYPES                                                                                                 │
│    27                                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/peft/tuners/__init__.py:26 in <module>                                                  │
│                                                                                                                                                            │
│   25 from .adalora import AdaLoraConfig, AdaLoraModel                                                                                                      │
│ ❱ 26 from .boft import BOFTConfig, BOFTModel                                                                                                               │
│   27 from .p_tuning import PromptEncoder, PromptEncoderConfig, PromptEncoderReparameterizationType                                                         │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/peft/tuners/boft/__init__.py:16 in <module>                                             │
│                                                                                                                                                            │
│   15 from .config import BOFTConfig                                                                                                                        │
│ ❱ 16 from .layer import BOFTLayer                                                                                                                          │
│   17 from .model import BOFTModel                                                                                                                          │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/peft/tuners/boft/layer.py:30 in <module>                                                │
│                                                                                                                                                            │
│    29 from torch.autograd import Function                                                                                                                  │
│ ❱  30 from torch.utils.cpp_extension import load                                                                                                           │
│    31                                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py:28 in <module>                                             │
│                                                                                                                                                            │
│     27                                                                                                                                                     │
│ ❱   28 from setuptools.command.build_ext import build_ext                                                                                                  │
│     29                                                                                                                                                     │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py:9 in <module>                                           │
│                                                                                                                                                            │
│     8                                                                                                                                                      │
│ ❱   9 from distutils.command.build_ext import build_ext as _du_build_ext                                                                                   │
│    10 from distutils.ccompiler import new_compiler                                                                                                         │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py:14 in <module>                               │
│                                                                                                                                                            │
│    13                                                                                                                                                      │
│ ❱  14 from .._modified import newer_group                                                                                                                  │
│    15 from ..core import Command                                                                                                                           │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/setuptools/_distutils/_modified.py:6 in <module>                                        │
│                                                                                                                                                            │
│    5                                                                                                                                                       │
│ ❱  6 from ._functools import splat                                                                                                                         │
│    7 from .errors import DistutilsFileError                                                                                                                │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
ImportError: cannot import name 'splat' from 'distutils._functools' (/mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/setuptools/_distutils/_functools.py)

The above exception was the direct cause of the following exception:

╭──────────────────────────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────────────────────────╮
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:830 in _get_module                                      │
│                                                                                                                                                            │
│   829         try:                                                                                                                                         │
│ ❱ 830             return importlib.import_module("." + module_name, self.__name__)                                                                         │
│   831         except Exception as e:                                                                                                                       │
│                                                                                                                                                            │
│ /usr/lib/python3.11/importlib/__init__.py:126 in import_module                                                                                             │
│                                                                                                                                                            │
│   125             level += 1                                                                                                                               │
│ ❱ 126     return _bootstrap._gcd_import(name[level:], package, level)                                                                                      │
│   127                                                                                                                                                      │
│ in _gcd_import:1206                                                                                                                                        │
│ in _find_and_load:1178                                                                                                                                     │
│ in _find_and_load_unlocked:1128                                                                                                                            │
│ in _call_with_frames_removed:241                                                                                                                           │
│ in _gcd_import:1206                                                                                                                                        │
│ in _find_and_load:1178                                                                                                                                     │
│ in _find_and_load_unlocked:1149                                                                                                                            │
│ in _load_unlocked:690                                                                                                                                      │
│ in exec_module:940                                                                                                                                         │
│ in _call_with_frames_removed:241                                                                                                                           │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/models/autoencoders/__init__.py:1 in <module>                                 │
│                                                                                                                                                            │
│ ❱ 1 from .autoencoder_asym_kl import AsymmetricAutoencoderKL                                                                                               │
│   2 from .autoencoder_kl import AutoencoderKL                                                                                                              │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/models/autoencoders/autoencoder_asym_kl.py:23 in <module>                     │
│                                                                                                                                                            │
│    22 from ..modeling_utils import ModelMixin                                                                                                              │
│ ❱  23 from .vae import DecoderOutput, DiagonalGaussianDistribution, Encoder, MaskConditionDecoder                                                          │
│    24                                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/models/autoencoders/vae.py:25 in <module>                                     │
│                                                                                                                                                            │
│    24 from ..attention_processor import SpatialNorm                                                                                                        │
│ ❱  25 from ..unets.unet_2d_blocks import (                                                                                                                 │
│    26     AutoencoderTinyBlock,                                                                                                                            │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/models/unets/__init__.py:6 in <module>                                        │
│                                                                                                                                                            │
│    5     from .unet_1d import UNet1DModel                                                                                                                  │
│ ❱  6     from .unet_2d import UNet2DModel                                                                                                                  │
│    7     from .unet_2d_condition import UNet2DConditionModel                                                                                               │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/models/unets/unet_2d.py:24 in <module>                                        │
│                                                                                                                                                            │
│    23 from ..modeling_utils import ModelMixin                                                                                                              │
│ ❱  24 from .unet_2d_blocks import UNetMidBlock2D, get_down_block, get_up_block                                                                             │
│    25                                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/models/unets/unet_2d_blocks.py:36 in <module>                                 │
│                                                                                                                                                            │
│     35 )                                                                                                                                                   │
│ ❱   36 from ..transformers.dual_transformer_2d import DualTransformer2DModel                                                                               │
│     37 from ..transformers.transformer_2d import Transformer2DModel                                                                                        │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/models/transformers/__init__.py:13 in <module>                                │
│                                                                                                                                                            │
│   12     from .pixart_transformer_2d import PixArtTransformer2DModel                                                                                       │
│ ❱ 13     from .prior_transformer import PriorTransformer                                                                                                   │
│   14     from .stable_audio_transformer import StableAudioDiTModel                                                                                         │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/models/transformers/prior_transformer.py:9 in <module>                        │
│                                                                                                                                                            │
│     8 from ...configuration_utils import ConfigMixin, register_to_config                                                                                   │
│ ❱   9 from ...loaders import PeftAdapterMixin, UNet2DConditionLoadersMixin                                                                                 │
│    10 from ...utils import BaseOutput                                                                                                                      │
│ in _handle_fromlist:1231                                                                                                                                   │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:820 in __getattr__                                      │
│                                                                                                                                                            │
│   819         elif name in self._class_to_module.keys():                                                                                                   │
│ ❱ 820             module = self._get_module(self._class_to_module[name])                                                                                   │
│   821             value = getattr(module, name)                                                                                                            │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:832 in _get_module                                      │
│                                                                                                                                                            │
│   831         except Exception as e:                                                                                                                       │
│ ❱ 832             raise RuntimeError(                                                                                                                      │
│   833                 f"Failed to import {self.__name__}.{module_name} because of the following error (look up to see its"                                 │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
RuntimeError: Failed to import diffusers.loaders.unet because of the following error (look up to see its traceback):
cannot import name 'splat' from 'distutils._functools' (/mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/setuptools/_distutils/_functools.py)

The above exception was the direct cause of the following exception:

╭──────────────────────────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────────────────────────╮
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:830 in _get_module                                      │
│                                                                                                                                                            │
│   829         try:                                                                                                                                         │
│ ❱ 830             return importlib.import_module("." + module_name, self.__name__)                                                                         │
│   831         except Exception as e:                                                                                                                       │
│                                                                                                                                                            │
│ /usr/lib/python3.11/importlib/__init__.py:126 in import_module                                                                                             │
│                                                                                                                                                            │
│   125             level += 1                                                                                                                               │
│ ❱ 126     return _bootstrap._gcd_import(name[level:], package, level)                                                                                      │
│   127                                                                                                                                                      │
│ in _gcd_import:1206                                                                                                                                        │
│ in _find_and_load:1178                                                                                                                                     │
│ in _find_and_load_unlocked:1149                                                                                                                            │
│ in _load_unlocked:690                                                                                                                                      │
│ in exec_module:940                                                                                                                                         │
│ in _call_with_frames_removed:241                                                                                                                           │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/pipelines/pipeline_utils.py:44 in <module>                                    │
│                                                                                                                                                            │
│     43 from ..configuration_utils import ConfigMixin                                                                                                       │
│ ❱   44 from ..models import AutoencoderKL                                                                                                                  │
│     45 from ..models.attention_processor import FusedAttnProcessor2_0                                                                                      │
│ in _handle_fromlist:1231                                                                                                                                   │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:820 in __getattr__                                      │
│                                                                                                                                                            │
│   819         elif name in self._class_to_module.keys():                                                                                                   │
│ ❱ 820             module = self._get_module(self._class_to_module[name])                                                                                   │
│   821             value = getattr(module, name)                                                                                                            │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:832 in _get_module                                      │
│                                                                                                                                                            │
│   831         except Exception as e:                                                                                                                       │
│ ❱ 832             raise RuntimeError(                                                                                                                      │
│   833                 f"Failed to import {self.__name__}.{module_name} because of the following error (look up to see its"                                 │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
RuntimeError: Failed to import diffusers.models.autoencoders.autoencoder_kl because of the following error (look up to see its traceback):
Failed to import diffusers.loaders.unet because of the following error (look up to see its traceback):
cannot import name 'splat' from 'distutils._functools' (/mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/setuptools/_distutils/_functools.py)

The above exception was the direct cause of the following exception:

╭──────────────────────────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────────────────────────╮
│ /mnt/exwin/esperimenti/automatic/launch.py:265 in <module>                                                                                                 │
│                                                                                                                                                            │
│   264 if __name__ == "__main__":                                                                                                                           │
│ ❱ 265     main()                                                                                                                                           │
│   266                                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/launch.py:242 in main                                                                                                     │
│                                                                                                                                                            │
│   241                                                                                                                                                      │
│ ❱ 242     uv, instance = start_server(immediate=True, server=None)                                                                                         │
│   243     while True:                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/launch.py:168 in start_server                                                                                             │
│                                                                                                                                                            │
│   167     get_custom_args()                                                                                                                                │
│ ❱ 168     module_spec.loader.exec_module(server)                                                                                                           │
│   169     uvicorn = None                                                                                                                                   │
│ in exec_module:940                                                                                                                                         │
│ in _call_with_frames_removed:241                                                                                                                           │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/webui.py:11 in <module>                                                                                                   │
│                                                                                                                                                            │
│    10 from threading import Thread                                                                                                                         │
│ ❱  11 import modules.loader                                                                                                                                │
│    12 import torch # pylint: disable=wrong-import-order                                                                                                    │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/modules/loader.py:80 in <module>                                                                                          │
│                                                                                                                                                            │
│    79 transformers.utils.logging.tqdm = _tqdm_cls()                                                                                                        │
│ ❱  80 diffusers.pipelines.pipeline_utils.logging.tqdm = _tqdm_cls()                                                                                        │
│    81 huggingface_hub._snapshot_download.hf_tqdm = _tqdm_old # pylint: disable=protected-access                                                            │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:818 in __getattr__                                      │
│                                                                                                                                                            │
│   817         if name in self._modules:                                                                                                                    │
│ ❱ 818             value = self._get_module(name)                                                                                                           │
│   819         elif name in self._class_to_module.keys():                                                                                                   │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/diffusers/utils/import_utils.py:832 in _get_module                                      │
│                                                                                                                                                            │
│   831         except Exception as e:                                                                                                                       │
│ ❱ 832             raise RuntimeError(                                                                                                                      │
│   833                 f"Failed to import {self.__name__}.{module_name} because of the following error (look up to see its"                                 │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
RuntimeError: Failed to import diffusers.pipelines.pipeline_utils because of the following error (look up to see its traceback):
Failed to import diffusers.models.autoencoders.autoencoder_kl because of the following error (look up to see its traceback):
Failed to import diffusers.loaders.unet because of the following error (look up to see its traceback):
cannot import name 'splat' from 'distutils._functools' (/mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/setuptools/_distutils/_functools.py)

Backend

Diffusers

UI

Standard

Branch

Master

Model

StableDiffusion 1.5

Acknowledgements

vladmandic commented 5 days ago

just to check, what happens if you start it again after the initial error? typically this is due to python libs mismatch and goes away after restart as sdnext installer fixes it, but it cannot reload some of the fixed libraries in the same pass.

grigio commented 4 days ago

I tried again with models in the folder and it seems gone, but it seems it doesn't proceed with the generation Progress ?it/s 0% 0/7 00:00 ? Base I don't get other errors.

$ ./webui.sh --use-rocm --listen
Activate python venv: /mnt/exwin/esperimenti/automatic/venv
Launch: venv/bin/python3
13:25:14-581956 INFO     Starting SD.Next                                                                                                                     
13:25:14-583534 INFO     Logger: file="/mnt/exwin/esperimenti/automatic/sdnext.log" level=INFO size=109998 mode=append                                        
13:25:14-584074 INFO     Python version=3.11.2 platform=Linux bin="/mnt/exwin/esperimenti/automatic/venv/bin/python3"                                         
                         venv="/mnt/exwin/esperimenti/automatic/venv"                                                                                         
13:25:14-593767 INFO     Version: app=sd.next updated=2024-09-13 hash=e7ec07f9 branch=master url=https://github.com/vladmandic/automatic/tree/master ui=main  
13:25:15-083682 INFO     Platform: arch=x86_64 cpu= system=Linux release=6.1.0-25-amd64 python=3.11.2                                                         
13:25:15-084777 INFO     HF cache folder: /home/g/.cache/huggingface/hub                                                                                      
13:25:15-088053 INFO     Using CPU-only Torch                                                                                                                 
13:25:15-116932 INFO     Verifying requirements                                                                                                               
13:25:15-119661 INFO     Verifying packages                                                                                                                   
13:25:15-122468 INFO     Extensions: disabled=[]                                                                                                              
13:25:15-123189 INFO     Extensions: enabled=['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui',     
                         'stable-diffusion-webui-rembg'] extensions-builtin                                                                                   
13:25:15-124396 INFO     Extensions: enabled=[] extensions                                                                                                    
13:25:15-125078 INFO     Startup: quick launch                                                                                                                
13:25:15-125700 INFO     Extensions: disabled=[]                                                                                                              
13:25:15-126270 INFO     Extensions: enabled=['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui',     
                         'stable-diffusion-webui-rembg'] extensions-builtin                                                                                   
13:25:15-127291 INFO     Extensions: enabled=[] extensions                                                                                                    
13:25:15-129085 INFO     Command line args: ['--use-rocm', '--listen'] listen=True use_rocm=True                                                              
13:25:17-559408 INFO     Load packages: {'torch': '2.4.1+cu121', 'diffusers': '0.31.0.dev0', 'gradio': '3.43.2'}                                              
13:25:17-871562 INFO     Engine: backend=Backend.DIFFUSERS compute=cpu device=cpu attention="Scaled-Dot-Product" mode=no_grad                                 
13:25:17-872315 INFO     Device:                                                                                                                              
13:25:18-041933 INFO     Available VAEs: path="models/VAE" items=0                                                                                            
13:25:18-042750 INFO     Disabled extensions: ['sdnext-modernui']                                                                                             
13:25:18-043718 INFO     Available models: path="models/Stable-diffusion" items=13 time=0.00                                                                  
13:25:18-072905 INFO     LoRA networks: available=0 folders=2                                                                                                 
13:25:18-219922 INFO     Extension: script='extensions-builtin/sd-webui-agent-scheduler/scripts/task_scheduler.py' Using sqlite file:                         
                         extensions-builtin/sd-webui-agent-scheduler/task_scheduler.sqlite3                                                                   
13:25:18-229017 INFO     UI theme: type=Standard name="black-teal"                                                                                            
13:25:18-934016 INFO     Extension list is empty: refresh required                                                                                            
13:25:19-046393 INFO     Local URL: http://localhost:7860/                                                                                                    
INFO:nncf:NNCF initialized successfully. Supported frameworks detected: torch, onnx, openvino
13:25:19-458903 WARNING  OpenVINO: No compatible GPU detected! Using CPU                                                                                      
13:25:19-495799 INFO     [AgentScheduler] Task queue is empty                                                                                                 
13:25:19-496410 INFO     [AgentScheduler] Registering APIs                                                                                                    
13:25:19-548342 INFO     Setting Torch parameters: device=cpu dtype=torch.float16 vae=torch.float16 unet=torch.float16 context=no_grad fp16=True bf16=None    
                         optimization=Scaled-Dot-Product                                                                                                      
13:25:19-549740 INFO     Select: model="juggernautXL_version3 [c4b501713f]"                                                                                   
13:25:19-551400 INFO     Autodetect: model="Stable Diffusion XL" class=StableDiffusionXLPipeline                                                              
                         file="/mnt/exwin/esperimenti/automatic/models/Stable-diffusion/juggernautXL_version3.safetensors" size=6617MB                        
Diffusers 15.66it/s ████████ 100% 7/7 00:00 00:00 Loading pipeline components...
13:25:20-026078 INFO     Load embeddings: loaded=0 skipped=0 time=0.00                                                                                        
13:25:20-306049 INFO     Load model: time=0.49 load=0.47 native=1024 {'ram': {'used': 1.77, 'total': 46.27}}                                                  
13:25:20-307431 INFO     Startup time: 5.17 torch=1.68 gradio=0.40 diffusers=0.06 libraries=0.75 extensions=0.16 ui-networks=0.07 ui-img2img=0.25             
                         ui-control=0.07 ui-models=0.10 ui-settings=0.14 launch=0.05 api=0.29 app-started=0.21 checkpoint=0.76                                
13:25:46-471424 INFO     Browser session: user=None client=192.168.1.78 agent=Mozilla/5.0 (X11; Linux x86_64; rv:130.0) Gecko/20100101 Firefox/130.0          
13:25:49-636032 INFO     MOTD: N/A                                                                                                                            
13:26:21-547759 INFO     Base: class=StableDiffusionXLPipeline                                                                                                

Progress ?it/s                                               0% 0/7 00:00 ? Base
grigio commented 4 days ago

OK, I finally got an error

13:36:21-626544 WARNING  OpenVINO: No compatible GPU detected! Using CPU                                                                                      
Progress ?it/s                                              0% 0/10 00:00 ? Base
13:37:20-602800 ERROR    Exception: new() received an invalid combination of arguments - got (Tensor, requires_grad=bool), but expected one of:               
                          * (*, torch.device device = None)                                                                                                   
                               didn't match because some of the keywords were incorrect: requires_grad                                                        
                          * (torch.Storage storage)                                                                                                           
                          * (Tensor other)                                                                                                                    
                          * (tuple of ints size, *, torch.device device = None)                                                                               
                          * (object data, *, torch.device device = None)                                                                                      

13:37:20-604004 ERROR    Arguments: args=('task(khw87o1lq23m0bs)', 'a dog', '', [], 10, 0, 28, True, False, False, False, 1, 1, 6, 6, 0.7, 0, 0.5, 1, 1, -1.0,
                         -1.0, 0, 0, 0, 512, 512, False, 0.3, 1, 1, 'Add with forward', 'None', False, 20, 0, 0, 10, 0, '', '', 0, 0, 0, 0, False, 4, 0.95,   
                         False, 0.6, 1, '#000000', 0, [], 0, 1, 'None', 'None', 'None', 'None', 0.5, 0.5, 0.5, 0.5, None, None, None, None, False, False,     
                         False, False, 0, 0, 0, 0, 1, 1, 1, 1, None, None, None, None, False, '', False, 0, '', [], 0, '', [], 0, '', [], False, True, False, 
                         False, False, False, 0, 'None', [], 'FaceID Base', True, True, 1, 1, 1, 0.5, True, 'person', 1, 0.5, True, 'None', 16, 'None', 1,    
                         True, 'None', 2, True, 1, 0, True, 'none', 3, 4, 0.25, 0.25, 'THUDM/CogVideoX-2b', 'DDIM', 49, 6, 'balanced', True, 'None', 8, True, 
                         1, 0, None, None, 3, 1, 1, 0.8, 8, 64, True, 0.65, True, False, 1, 1, 1, True, 0.5, 600.0, 1.0, True, None, 1, 0, 0, 0, 0, 0, 0, 0,  
                         1, 1, 1, 0.5, 0.5, 'OpenGVLab/InternVL-14B-224px', False, 0.7, 1.2, 128, False, False, 'positive', 'comma', 0, False, False, '',     
                         'None', '', 1, '', 'None', 1, True, 10, 'None', True, 0, 'None', 2, True, 1, 0, 0, '', [], 0, '', [], 0, '', [], False, True, False, 
                         False, False, False, 0) kwargs={}                                                                                                    
13:37:20-606650 ERROR    gradio call: TypeError                                                                                                               
╭──────────────────────────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────────────────────────╮
│ /mnt/exwin/esperimenti/automatic/modules/call_queue.py:31 in f                                                                                             │
│                                                                                                                                                            │
│   30 │   │   │   try:                                                                                                                                      │
│ ❱ 31 │   │   │   │   res = func(*args, **kwargs)                                                                                                           │
│   32 │   │   │   │   progress.record_results(id_task, res)                                                                                                 │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/modules/txt2img.py:93 in txt2img                                                                                          │
│                                                                                                                                                            │
│    92 │   if processed is None:                                                                                                                            │
│ ❱  93 │   │   processed = processing.process_images(p)                                                                                                     │
│    94 │   processed = scripts.scripts_txt2img.after(p, processed, *args)                                                                                   │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/modules/processing.py:191 in process_images                                                                               │
│                                                                                                                                                            │
│   190 │   │   │   with context_hypertile_vae(p), context_hypertile_unet(p):                                                                                │
│ ❱ 191 │   │   │   │   processed = process_images_inner(p)                                                                                                  │
│   192                                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/modules/processing.py:312 in process_images_inner                                                                         │
│                                                                                                                                                            │
│   311 │   │   │   │   │   from modules.processing_diffusers import process_diffusers                                                                       │
│ ❱ 312 │   │   │   │   │   x_samples_ddim = process_diffusers(p)                                                                                            │
│   313 │   │   │   │   else:                                                                                                                                │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/modules/processing_diffusers.py:108 in process_diffusers                                                                  │
│                                                                                                                                                            │
│   107 │   │   else:                                                                                                                                        │
│ ❱ 108 │   │   │   output = shared.sd_model(**base_args)                                                                                                    │
│   109 │   │   if isinstance(output, dict):                                                                                                                 │
│                                                                                                                                                            │
│                                                                  ... 9 frames hidden ...                                                                   │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/torch/nn/modules/module.py:1553 in _wrapped_call_impl                                   │
│                                                                                                                                                            │
│   1552 │   │   else:                                                                                                                                       │
│ ❱ 1553 │   │   │   return self._call_impl(*args, **kwargs)                                                                                                 │
│   1554                                                                                                                                                     │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/torch/nn/modules/module.py:1562 in _call_impl                                           │
│                                                                                                                                                            │
│   1561 │   │   │   │   or _global_forward_hooks or _global_forward_pre_hooks):                                                                             │
│ ❱ 1562 │   │   │   return forward_call(*args, **kwargs)                                                                                                    │
│   1563                                                                                                                                                     │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/accelerate/hooks.py:171 in new_forward                                                  │
│                                                                                                                                                            │
│   170 │   │   │   output = module._old_forward(*args, **kwargs)                                                                                            │
│ ❱ 171 │   │   return module._hf_hook.post_forward(module, output)                                                                                          │
│   172                                                                                                                                                      │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/accelerate/hooks.py:376 in post_forward                                                 │
│                                                                                                                                                            │
│   375 │   │   │   ):                                                                                                                                       │
│ ❱ 376 │   │   │   │   set_module_tensor_to_device(module, name, "meta")                                                                                    │
│   377 │   │   │   │   if type(module).__name__ == "Linear8bitLt":                                                                                          │
│                                                                                                                                                            │
│ /mnt/exwin/esperimenti/automatic/venv/lib/python3.11/site-packages/accelerate/utils/modeling.py:440 in set_module_tensor_to_device                         │
│                                                                                                                                                            │
│    439 │   │   │   else:                                                                                                                                   │
│ ❱  440 │   │   │   │   new_value = param_cls(new_value, requires_grad=old_value.requires_grad).to(device)                                                  │
│    441                                                                                                                                                     │
╰───────────────────────────────
vladmandic commented 4 days ago

you started with ./webui.sh --use-rocm, but its trying to use openvino instead. seems something went wrong with install/detection of correct torch to start with.

start with ./webui.sh --use-rocm --reinstall so correct torch gets reinstalled