siliconflow / onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.
https://github.com/siliconflow/onediff/wiki
Apache License 2.0
1.4k stars 85 forks source link

webui中使用regional-prompter插件时编译模型报错 #844

Open jjl001 opened 2 months ago

jjl001 commented 2 months ago

在webui中使用regional-prompter插件,编译模型时会报错。 插件地址:https://github.com/hako-mikan/sd-webui-regional-prompter 插件有2种模式,分别是 Attention 和 Latent 其中Latent模式可以使用onediff加速 Attention模式在加载模型时会报错,错误内容如下

(venv) [root@VM-0-64-centos stable-diffusion-webui]# sh webui.sh -f --no-half-vae --skip-install --listen --port 7863 --disable-safe-unpickle --skip-version-check --controlnet-annotator-models-path /aigc_dev/stable-diffusion-webui/models/ --enable-insecure-extension-access

################################################################ Install script for stable-diffusion + Web UI Tested on Debian 11 (Bullseye) ################################################################

################################################################ Running on root user ################################################################

################################################################ Repo already cloned, using it as install directory ################################################################

################################################################ python venv already activate or run without venv: /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv ################################################################

################################################################ Launching launch.py... ################################################################ Cannot locate TCMalloc (improves CPU memory usage) Python 3.10.9 (main, Mar 1 2023, 18:23:06) [GCC 11.2.0] Version: v1.7.0 Commit hash: cf2772fab0af5573da775e7437e6acdca424f26e Launching Web UI with arguments: -f --no-half-vae --skip-install --listen --port 7863 --disable-safe-unpickle --skip-version-check --controlnet-annotator-models-path /aigc_dev/stable-diffusion-webui/models/ --enable-insecure-extension-access No module 'xformers'. Proceeding without it. Style database not found: /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/styles.csv [-] ADetailer: Failed to load model 'face_yolov8n.pt' from huggingface [-] ADetailer initialized. version: 24.3.0, num models: 14 WARNING [2024-04-29 13:49:23] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/manager.py:119 - Pydantic version 1.10.13 is too low, please upgrade to 2.5.2 or higher. WARNING [2024-04-29 13:49:24] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.. at 0x7fcfdefb8af0> with parameters Module: <module 'modules.sd_hijack_utils' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py'> WARNING [2024-04-29 13:49:24] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function create_unet_forward..UNetModel_forward at 0x7fd029a3d480> with parameters Module: <module 'modules.sd_unet' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_unet.py'> no module 'xformers'. Processing without... No SDP backend available, likely because you are running in pytorch versions < 2.0. In fact, you are using PyTorch 0.9.1.dev20240425+cu118. You might want to consider upgrading. no module 'xformers'. Processing without... WARNING [2024-04-29 13:49:24] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.. at 0x7fcfdefb93f0> with parameters Module: <module 'modules.sd_hijack_utils' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py'> WARNING [2024-04-29 13:49:25] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function create_unet_forward..UNetModel_forward at 0x7fcfdeff8d30> with parameters Module: <module 'modules.sd_unet' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_unet.py'> ControlNet preprocessor location: /aigc_dev/stable-diffusion-webui/models 2024-04-29 13:49:25,506 - ControlNet - INFO - ControlNet v1.1.443 2024-04-29 13:49:26,089 - ControlNet - INFO - ControlNet v1.1.443 == WD14 tagger /gpu:0, uname_result(system='Linux', node='VM-0-64-centos', release='4.18.0-348.7.1.el8_5.x86_64', version='#1 SMP Wed Dec 22 13:25:12 UTC 2021', machine='x86_64') == Loading weights [d6a48d3e20] from /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/models/Stable-diffusion/sd-xl/realvisxlV40_v40LightningBakedvae.safetensors WARNING [2024-04-29 13:49:31] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/version_util.py:21 - Failed to import onediff_quant, Error message: No module named 'onediff_quant', OneDiff Enterprise Edition features can't be used, please refer to here for help: https://github.com/siliconflow/onediff?tab=readme-ov-file#community--support WARNING [2024-04-29 13:49:31] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/optimization/quant_optimizer.py:17 - OneDiff Quantization can't be used. 2024-04-29 13:49:31,889 - ControlNet - INFO - ControlNet UI callback registered. WARNING [2024-04-29 13:49:31] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/version_util.py:21 - Failed to import onediff_quant, Error message: No module named 'onediff_quant', OneDiff Enterprise Edition features can't be used, please refer to here for help: https://github.com/siliconflow/onediff?tab=readme-ov-file#community--support WARNING [2024-04-29 13:49:31] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/optimization/quant_optimizer.py:17 - OneDiff Quantization can't be used. Running on local URL: http://0.0.0.0:7863

To create a public link, set share=True in launch(). Startup time: 47.0s (prepare environment: 3.7s, import torch: 6.6s, import gradio: 2.2s, setup paths: 3.2s, initialize shared: 5.4s, other imports: 1.7s, setup codeformer: 0.3s, list SD models: 0.2s, load scripts: 21.5s, create ui: 1.7s, gradio launch: 0.3s). Creating model from config: /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/generative-models/configs/inference/sd_xl_base.yaml Applying attention optimization: Doggettx... done. Model loaded in 4.7s (load weights from disk: 2.0s, create model: 0.4s, apply weights to model: 1.2s, calculate empty prompt: 0.9s). 1;1;1 0.2 Horizontal Token indices sequence length is longer than the specified maximum sequence length for this model (439 > 77). Running this sequence through the model will result in indexing errors Token indices sequence length is longer than the specified maximum sequence length for this model (439 > 77). Running this sequence through the model will result in indexing errors Regional Prompter Active, Pos tokens : [1, 3], Neg tokens : [444] 0%| | 0/5 [00:00<?, ?it/s]WARNING [2024-04-29 13:50:11] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.. at 0x7fcfdefb93f0> with parameters Module: <module 'modules.sd_hijack_utils' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py'> WARNING:ONEDIFF:Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.. at 0x7fcfdefb93f0> with parameters Module: <module 'modules.sd_hijack_utils' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py'> WARNING [2024-04-29 13:50:11] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.. at 0x7fcfdefb93f0> with parameters Module: <module 'modules.sd_hijack_utils' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py'> WARNING:ONEDIFF:Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.. at 0x7fcfdefb93f0> with parameters Module: <module 'modules.sd_hijack_utils' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py'> WARNING [2024-04-29 13:50:12] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.. at 0x7fcfdefb93f0> with parameters Module: <module 'modules.sd_hijack_utils' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py'> WARNING:ONEDIFF:Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.. at 0x7fcfdefb93f0> with parameters Module: <module 'modules.sd_hijack_utils' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py'> WARNING [2024-04-29 13:50:14] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/log_utils.py:33 - Logging handlers already exist for ONEDIFF WARNING:ONEDIFF:Logging handlers already exist for ONEDIFF WARNING:onediff.infer_compiler.utils.log_utils:Pydantic version 1.10.13 is too low, please upgrade to 2.5.2 or higher. WARNING [2024-04-29 13:50:15] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> WARNING:ONEDIFF:Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> WARNING [2024-04-29 13:50:15] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> WARNING:ONEDIFF:Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> WARNING [2024-04-29 13:50:16] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> WARNING:ONEDIFF:Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> ERROR [2024-04-29 13:50:16] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py:217 - convert <class 'function'> failed: Transform failed of <class 'function'>: 'function' object has no attribute '' ERROR:ONEDIFF:convert <class 'function'> failed: Transform failed of <class 'function'>: 'function' object has no attribute '' ERROR [2024-04-29 13:50:16] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/utils.py:23 - Exception in forward: e=NotImplementedError("Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>") ERROR:ONEDIFF:Exception in forward: e=NotImplementedError("Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>") WARNING [2024-04-29 13:50:16] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/utils.py:24 - Recompile oneflow module ... WARNING:ONEDIFF:Recompile oneflow module ... WARNING [2024-04-29 13:50:16] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> WARNING:ONEDIFF:Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> WARNING [2024-04-29 13:50:16] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> WARNING:ONEDIFF:Failed to update obj_entity in place. Exception: Not support <function singledispatch_proxy..wrapper at 0x7fceb0181fc0> with parameters Module: <module 'onediff.infer_compiler.transform.builtin_transform' from '/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py'> ERROR [2024-04-29 13:50:16] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py:217 - convert <class 'function'> failed: Transform failed of <class 'function'>: 'function' object has no attribute '' ERROR:ONEDIFF:convert <class 'function'> failed: Transform failed of <class 'function'>: 'function' object has no attribute '' 0%| | 0/5 [00:05<?, ?it/s] Error completing request Arguments: ('task(gs753tmqzx06xly)', 'background BREAK\nblue sky.', 'cropped,blurred,mutated,error,lowres,polar lowres,jpeg artifacts,bad shadow,blurry,normal quality,worst quality,low quality,username,signature,ui,text font ui,watermark,text,missing limb,fused hand,missing hand,more than 1 left hand,more than 1 right hand,more than 1 right hand,short arms,extra limbs,malformed limbs,bad hands,malformed hands,mutilated hands,mutated hands,poorly drawn hands,extra arms,disappearing arms,missing arms,one hand with more tha,one hand with less than,extra fingers,fused fingers,missing fingers,too many fingers,extra digits,fewer digits,one hand with more tha.,one hand with less than,extra digit,bad digit,fused digit,liquid digit,missing digit,missing limb,bad knee,extra calf,fused calf,huge calf,disappearing calf,missing calf,disappearing thigh,extra limbs,malformed limbs,extra legs,disappearing legs,missing legs,more than 2 thighs,extra thighs,huge thighs,missing thighs,extra feet,bad feet,malformed feet,fused feet,missing feet,poorly drawn feet,extra breasts,bad breasts,fused breasts,liquid breasts,huge breasts,missing breasts,poorly drawn breasts,heavy breasts,deformed,mutilated,morbid,anatomicalnonsense,mutation,big muscles,bad proportions,bad body,uncoordinated body,unnatural body,bad anatomy,huge haunch,long neck,nsfw,cloned face,duplicate face,multiple people,malformed,disfigured,poorly drawn face,out of frame,ugly,extra ears,bad ears,fused ears,liquid ears,missing ears,extra animalears,bad animalears,liquid animal ears,missing animal ears,poorly drawn animal ears,heavy animalears,poorly drawn ears,heavy ears,black tongue,colorful tongue,bad hairs,fused hairs,poorly drawn hairs,cross-eyed,extra eyes,bad eyes,fused eyes,poorly drawn eyes,unclear eyes,bad face,fused face,big face,long face', [], 5, 'DPM++ SDE', 1, 1, 1, 1024, 1024, False, 0.7, 2, 'Latent', 0, 0, 0, 'Use same checkpoint', 'Use same sampler', '', '', [], <gradio.routes.Request object at 0x7fcdcceacd60>, 4, False, '', 0.8, 1871545376, False, -1, 0, 0, 0, False, False, False, False, 'base', True, False, {'ad_model': 'face_yolov8m.pt', 'ad_model_classes': '', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_k_largest': 0, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 4, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 4, 'ad_denoising_strength': 0.4, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': False, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_checkpoint': False, 'ad_checkpoint': 'Use same checkpoint', 'ad_use_vae': False, 'ad_vae': 'Use same VAE', 'ad_use_sampler': False, 'ad_sampler': 'DPM++ 2M Karras', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_use_clip_skip': False, 'ad_clip_skip': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'None', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, {'ad_model': 'None', 'ad_model_classes': '', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_k_largest': 0, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 4, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 4, 'ad_denoising_strength': 0.4, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': False, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_checkpoint': False, 'ad_checkpoint': 'Use same checkpoint', 'ad_use_vae': False, 'ad_vae': 'Use same VAE', 'ad_use_sampler': False, 'ad_sampler': 'DPM++ 2M Karras', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_use_clip_skip': False, 'ad_clip_skip': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'None', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None), True, False, 'Matrix', 'Columns', 'Mask', 'Prompt', '1;1;1', '0.2', False, False, False, 'Attention', ['[', '"', '[', '"'], '0', '0', '0.4', {'image': array([[[ 64, 128, 128], [ 64, 128, 128], [ 64, 128, 128], ..., [ 64, 128, 128], [ 64, 128, 128], [255, 255, 255]],


[[ 64, 128, 128], [ 64, 128, 128], [ 64, 128, 128], ..., [ 64, 128, 128], [ 64, 128, 128], *** [255, 255, 255]],


[[ 64, 128, 128], [ 64, 128, 128], [ 64, 128, 128], ..., [ 64, 128, 128], [ 64, 128, 128], *** [255, 255, 255]],


*** ...,


[[ 64, 128, 128], [ 64, 128, 128], [ 64, 128, 128], ..., [ 64, 128, 128], [ 64, 128, 128], *** [255, 255, 255]],


[[ 64, 128, 128], [ 64, 128, 128], [ 64, 128, 128], ..., [ 64, 128, 128], [ 64, 128, 128], *** [255, 255, 255]],


[[255, 255, 255], [255, 255, 255], [255, 255, 255], ..., [255, 255, 255], [255, 255, 255], [255, 255, 255]]], dtype=uint8), 'mask': array([[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],


[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],


[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],


*** ...,


[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],


[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],


[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], [0, 0, 0]]], dtype=uint8)}, '0', '0', False, False, False, 'positive', 'comma', 0, False, False, 'start', '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0, False, '\n

\n
\n Hints Message\n
\n
\n Hints: Enterprise function is not supported on your system.\n
\n

\n If you need Enterprise Level Support for your system or business, please send an email to \n business@siliconflow.com.\n
\n Tell us about your use case, deployment scale, and requirements.\n

\n

\n GitHub Issue:\n https://github.com/siliconflow/onediff/issues\n

\n
\n ', None, None, False, None, None, False, None, None, False, 50, [], 30, '', 4, [], 1, '', '', '', '') {} Traceback (most recent call last): File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper result = dispatcher(first_param, args, kwargs) File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper return dispatch(args[0].class)(*args, **kw) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtintransform.py", line 467, in return transform_mgr.transform_func(func) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/manager.py", line 102, in transform_func return self._transform_entity(func) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/manager.py", line 59, in _transform_entity result = self.mocker.mock_entity(entity) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/importer.py", line 94, in mock_entity return self.load_entity_with_mock(entity) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/importer.py", line 132, in load_entity_with_mock mock_pkg = getattr(mock_pkg, name) AttributeError: 'function' object has no attribute ''

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 215, in init
    self.__dict__[k] = torch2oflow(attr)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'function'>: 'function' object has no attribute '<locals>'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
    of_mod = of_mod_cls()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 218, in init
    raise NotImplementedError(f"Unsupported type: {type(attr)}")
NotImplementedError: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
    of_mod = of_mod_cls()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
    self._modules[n] = torch2oflow(m)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 352, in _
    submod = torch2oflow(original_submod, verbose)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
    of_mod = of_mod_cls()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
    self._modules[n] = torch2oflow(m)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 362, in _
    submod = torch2oflow(original_submod, verbose)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 352, in _
    submod = torch2oflow(original_submod, verbose)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
    of_mod = of_mod_cls()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
    self._modules[n] = torch2oflow(m)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/utils.py", line 21, in wrapper
    return func(self, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/graph_management_utils.py", line 91, in wrapper
    ret = func(self, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward
    dpl_graph = self.get_graph()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph
    self._deployable_module_model.oneflow_module,
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module
    self._oneflow_module = torch2oflow(self._torch_module)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 467, in _
    return transform_mgr.transform_func(func)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/manager.py", line 102, in transform_func
    return self._transform_entity(func)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/manager.py", line 59, in _transform_entity
    result = self.mocker.mock_entity(entity)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/importer.py", line 94, in mock_entity
    return self.load_entity_with_mock(entity)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/importer.py", line 132, in load_entity_with_mock
    mock_pkg = getattr(mock_pkg, name)
AttributeError: 'function' object has no attribute '<locals>'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 215, in init
    self.__dict__[k] = torch2oflow(attr)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'function'>: 'function' object has no attribute '<locals>'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
    of_mod = of_mod_cls()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 218, in init
    raise NotImplementedError(f"Unsupported type: {type(attr)}")
NotImplementedError: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
    of_mod = of_mod_cls()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
    self._modules[n] = torch2oflow(m)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 352, in _
    submod = torch2oflow(original_submod, verbose)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
    of_mod = of_mod_cls()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
    self._modules[n] = torch2oflow(m)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 362, in _
    submod = torch2oflow(original_submod, verbose)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 352, in _
    submod = torch2oflow(original_submod, verbose)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
    result = dispatcher(first_param, *args, **kwargs)
  File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
    return dispatch(args[0].__class__)(*args, **kw)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
    of_mod = of_mod_cls()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
    self._modules[n] = torch2oflow(m)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/call_queue.py", line 57, in f
    res = list(func(*args, **kwargs))
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/call_queue.py", line 36, in f
    res = func(*args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/txt2img.py", line 52, in txt2img
    processed = modules.scripts.scripts_txt2img.run(p, *args)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/scripts.py", line 700, in run
    processed = script.run(p, *script_args)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/extensions/onediff_sd_webui_extensions/scripts/onediff.py", line 216, in run
    proc = process_images(p)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/processing.py", line 734, in process_images
    res = process_images_inner(p)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/extensions/sd-webui-controlnet/scripts/batch_hijack.py", line 59, in processing_process_images_hijack
    return getattr(processing, '__controlnet_original_process_images_inner')(p, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/processing.py", line 868, in process_images_inner
    samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)   # 跳转到1139
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/processing.py", line 1142, in sample
    samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_samplers_kdiffusion.py", line 235, in sample
    samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_samplers_common.py", line 261, in launch_sampling
    return func()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_samplers_kdiffusion.py", line 235, in <lambda>
    samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/k-diffusion/k_diffusion/sampling.py", line 553, in sample_dpmpp_sde
    denoised = model(x, sigmas[i] * s_in, **extra_args)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_samplers_cfg_denoiser.py", line 188, in forward
    x_out[a:b] = self.inner_model(x_in[a:b], sigma_in[a:b], cond=make_condition_dict(c_crossattn, image_cond_in[a:b]))
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/k-diffusion/k_diffusion/external.py", line 112, in forward
    eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/k-diffusion/k_diffusion/external.py", line 138, in get_eps
    return self.inner_model.apply_model(*args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_models_xl.py", line 37, in apply_model
    return self.model(x, t, cond)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py", line 17, in <lambda>
    setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py", line 28, in __call__
    return self.__orig_func(*args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/generative-models/sgm/modules/diffusionmodules/wrappers.py", line 28, in forward
    return self.diffusion_model(
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1538, in _call_impl
    result = forward_call(*args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/online_quantization_utils.py", line 48, in wrapper
    output = func(self, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/args_tree_util.py", line 50, in wrapper
    output = func(self, *mapped_args, **mapped_kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/utils.py", line 27, in wrapper
    return func(self, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/graph_management_utils.py", line 91, in wrapper
    ret = func(self, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward
    dpl_graph = self.get_graph()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph
    self._deployable_module_model.oneflow_module,
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module
    self._oneflow_module = torch2oflow(self._torch_module)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/graph_management_utils.py", line 91, in wrapper
    ret = func(self, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward
    dpl_graph = self.get_graph()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph
    self._deployable_module_model.oneflow_module,
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module
    self._oneflow_module = torch2oflow(self._torch_module)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>

mpiler/utils/graph_management_utils.py", line 91, in wrapper ret = func(self, *args, **kwargs) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward dpl_graph = self.get_graph() File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph self._deployable_module_model.oneflow_module, File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module self._oneflow_module = torch2oflow(self._torch_module) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}") NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>


    return func(self, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/graph_management_utils.py", line 91, in wrapper
    ret = func(self, *args, **kwargs)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward
    dpl_graph = self.get_graph()
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph
    self._deployable_module_model.oneflow_module,
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module
    self._oneflow_module = torch2oflow(self._torch_module)
  File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
    raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
lijunliangTG commented 1 week ago

我在以下 OneDiff 版本中进行测试,没有复现您的问题 Oneflow版本 version: 0.9.1.dev20240515+cu122 git_commit: ec7b682

OneDiff 5677af57 并且按照这一行修改,可以正常运行 https://github.com/siliconflow/onediff/pull/930/files#diff-825f0891e328ecb32fdabc7d3741b57007e5edf2110124ad2974c52d703401c1R7(我们将在近期合并这个分支) 您可以尝试通过更新OneDiff 版本来进行尝试。如果还是不行,可以请您提供一下 OneDiff 和 Oneflow git hash 以便我们复现您的bug吗? OneDiff  attention OneDiff  Quant attention