search

picobyte / stable-diffusion-webui-wd14-tagger

Labeling extension for Automatic1111's Web UI
539 stars 64 forks source link

Installing tagger causes webui to crash on Mac M3 Max #93

Closed hal0thane closed 6 months ago

hal0thane commented 6 months ago

Brand new system. Installed webui, all was working well. Installed dynamic prompts, reload UI, all is good. Installed latent mirror, reload UI, all is good. Installed wd14-tagger, shut down and restarted webui.sh, and now every time I try to run webui.sh, it crashes with an Illegal Instruction:

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye), Fedora 34+ and openSUSE Leap 15.4 or newer.
################################################################

################################################################
Running on hal0 user
################################################################

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
Python 3.10.13 (main, Aug 24 2023, 22:48:59) [Clang 14.0.3 (clang-1403.0.22.14.1)]
Version: v1.7.0
Commit hash: cf2772fab0af5573da775e7437e6acdca424f26e
Installing torch and torchvision
Collecting torch==2.0.1
  Using cached torch-2.0.1-cp310-none-macosx_10_9_x86_64.whl (143.4 MB)
Collecting torchvision==0.15.2
  Using cached torchvision-0.15.2-cp310-cp310-macosx_10_9_x86_64.whl (1.5 MB)
Collecting filelock (from torch==2.0.1)
  Obtaining dependency information for filelock from https://files.pythonhosted.org/packages/81/54/84d42a0bee35edba99dee7b59a8d4970eccdd44b99fe728ed912106fc781/filelock-3.13.1-py3-none-any.whl.metadata
  Using cached filelock-3.13.1-py3-none-any.whl.metadata (2.8 kB)
Collecting typing-extensions (from torch==2.0.1)
  Obtaining dependency information for typing-extensions from https://files.pythonhosted.org/packages/b7/f4/6a90020cd2d93349b442bfcb657d0dc91eee65491600b2cb1d388bc98e6b/typing_extensions-4.9.0-py3-none-any.whl.metadata
  Using cached typing_extensions-4.9.0-py3-none-any.whl.metadata (3.0 kB)
Collecting sympy (from torch==2.0.1)
  Using cached sympy-1.12-py3-none-any.whl (5.7 MB)
Collecting networkx (from torch==2.0.1)
  Obtaining dependency information for networkx from https://files.pythonhosted.org/packages/d5/f0/8fbc882ca80cf077f1b246c0e3c3465f7f415439bdea6b899f6b19f61f70/networkx-3.2.1-py3-none-any.whl.metadata
  Using cached networkx-3.2.1-py3-none-any.whl.metadata (5.2 kB)
Collecting jinja2 (from torch==2.0.1)
  Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting numpy (from torchvision==0.15.2)
  Obtaining dependency information for numpy from https://files.pythonhosted.org/packages/76/ac/dea2939dfc3c591a2494121669455fd7d049248ef284c9542904ddbe05d5/numpy-1.26.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached numpy-1.26.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata (61 kB)
Collecting requests (from torchvision==0.15.2)
  Obtaining dependency information for requests from https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl.metadata
  Using cached requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting pillow!=8.3.*,>=5.3.0 (from torchvision==0.15.2)
  Obtaining dependency information for pillow!=8.3.*,>=5.3.0 from https://files.pythonhosted.org/packages/cb/64/1a4fb688fb4e1a8c621b49ac398858d49f0d6c9289b06027a3f0d4027568/Pillow-10.1.0-cp310-cp310-macosx_10_10_x86_64.whl.metadata
  Using cached Pillow-10.1.0-cp310-cp310-macosx_10_10_x86_64.whl.metadata (9.5 kB)
Collecting MarkupSafe>=2.0 (from jinja2->torch==2.0.1)
  Obtaining dependency information for MarkupSafe>=2.0 from https://files.pythonhosted.org/packages/f7/9c/86cbd8e0e1d81f0ba420f20539dd459c50537c7751e28102dbfee2b6f28c/MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (3.0 kB)
Collecting charset-normalizer<4,>=2 (from requests->torchvision==0.15.2)
  Obtaining dependency information for charset-normalizer<4,>=2 from https://files.pythonhosted.org/packages/cc/94/f7cf5e5134175de79ad2059edf2adce18e0685ebdb9227ff0139975d0e93/charset_normalizer-3.3.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata
  Using cached charset_normalizer-3.3.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata (33 kB)
Collecting idna<4,>=2.5 (from requests->torchvision==0.15.2)
  Obtaining dependency information for idna<4,>=2.5 from https://files.pythonhosted.org/packages/c2/e7/a82b05cf63a603df6e68d59ae6a68bf5064484a0718ea5033660af4b54a9/idna-3.6-py3-none-any.whl.metadata
  Using cached idna-3.6-py3-none-any.whl.metadata (9.9 kB)
Collecting urllib3<3,>=1.21.1 (from requests->torchvision==0.15.2)
  Obtaining dependency information for urllib3<3,>=1.21.1 from https://files.pythonhosted.org/packages/96/94/c31f58c7a7f470d5665935262ebd7455c7e4c7782eb525658d3dbf4b9403/urllib3-2.1.0-py3-none-any.whl.metadata
  Using cached urllib3-2.1.0-py3-none-any.whl.metadata (6.4 kB)
Collecting certifi>=2017.4.17 (from requests->torchvision==0.15.2)
  Obtaining dependency information for certifi>=2017.4.17 from https://files.pythonhosted.org/packages/64/62/428ef076be88fa93716b576e4a01f919d25968913e817077a386fcbe4f42/certifi-2023.11.17-py3-none-any.whl.metadata
  Using cached certifi-2023.11.17-py3-none-any.whl.metadata (2.2 kB)
Collecting mpmath>=0.19 (from sympy->torch==2.0.1)
  Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)
Using cached Pillow-10.1.0-cp310-cp310-macosx_10_10_x86_64.whl (3.5 MB)
Using cached filelock-3.13.1-py3-none-any.whl (11 kB)
Using cached networkx-3.2.1-py3-none-any.whl (1.6 MB)
Using cached numpy-1.26.2-cp310-cp310-macosx_10_9_x86_64.whl (20.6 MB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached typing_extensions-4.9.0-py3-none-any.whl (32 kB)
Using cached certifi-2023.11.17-py3-none-any.whl (162 kB)
Using cached charset_normalizer-3.3.2-cp310-cp310-macosx_10_9_x86_64.whl (122 kB)
Using cached idna-3.6-py3-none-any.whl (61 kB)
Using cached MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl (13 kB)
Using cached urllib3-2.1.0-py3-none-any.whl (104 kB)
Installing collected packages: mpmath, urllib3, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, idna, filelock, charset-normalizer, certifi, requests, jinja2, torch, torchvision
Successfully installed MarkupSafe-2.1.3 certifi-2023.11.17 charset-normalizer-3.3.2 filelock-3.13.1 idna-3.6 jinja2-3.1.2 mpmath-1.3.0 networkx-3.2.1 numpy-1.26.2 pillow-10.1.0 requests-2.31.0 sympy-1.12 torch-2.0.1 torchvision-0.15.2 typing-extensions-4.9.0 urllib3-2.1.0

[notice] A new release of pip is available: 23.2.1 -> 23.3.2
[notice] To update, run: pip install --upgrade pip
Installing clip
Installing open_clip
Installing requirements for CodeFormer
Installing requirements
Collecting send2trash~=1.8
  Using cached Send2Trash-1.8.2-py3-none-any.whl (18 kB)
Collecting dynamicprompts[attentiongrabber,magicprompt]~=0.30.4
  Obtaining dependency information for dynamicprompts[attentiongrabber,magicprompt]~=0.30.4 from https://files.pythonhosted.org/packages/55/18/ee387122d87c2f00c5a745cd1c43e25d48ffd0c072607fa2c7152c365991/dynamicprompts-0.30.4-py3-none-any.whl.metadata
  Using cached dynamicprompts-0.30.4-py3-none-any.whl.metadata (18 kB)
Requirement already satisfied: jinja2~=3.1 in ./venv/lib/python3.10/site-packages (from dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (3.1.2)
Requirement already satisfied: pyparsing~=3.0 in ./venv/lib/python3.10/site-packages (from dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (3.1.1)
Requirement already satisfied: transformers[torch]~=4.19 in ./venv/lib/python3.10/site-packages (from dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (4.30.2)
Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.10/site-packages (from jinja2~=3.1->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (2.1.3)
Requirement already satisfied: filelock in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (3.13.1)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (0.20.1)
Requirement already satisfied: numpy>=1.17 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (1.23.5)
Requirement already satisfied: packaging>=20.0 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (23.2)
Requirement already satisfied: pyyaml>=5.1 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (6.0.1)
Requirement already satisfied: regex!=2019.12.17 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (2023.10.3)
Requirement already satisfied: requests in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (2.31.0)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (0.13.3)
Requirement already satisfied: safetensors>=0.3.1 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (0.3.1)
Requirement already satisfied: tqdm>=4.27 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (4.66.1)
Requirement already satisfied: torch!=1.12.0,>=1.9 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (2.0.1)
Requirement already satisfied: accelerate>=0.20.2 in ./venv/lib/python3.10/site-packages (from transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (0.21.0)
Requirement already satisfied: psutil in ./venv/lib/python3.10/site-packages (from accelerate>=0.20.2->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (5.9.5)
Requirement already satisfied: fsspec>=2023.5.0 in ./venv/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (2023.12.2)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./venv/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (4.9.0)
Requirement already satisfied: sympy in ./venv/lib/python3.10/site-packages (from torch!=1.12.0,>=1.9->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (1.12)
Requirement already satisfied: networkx in ./venv/lib/python3.10/site-packages (from torch!=1.12.0,>=1.9->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (3.2.1)
Requirement already satisfied: charset-normalizer<4,>=2 in ./venv/lib/python3.10/site-packages (from requests->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in ./venv/lib/python3.10/site-packages (from requests->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (3.6)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./venv/lib/python3.10/site-packages (from requests->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.10/site-packages (from requests->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (2023.11.17)
Requirement already satisfied: mpmath>=0.19 in ./venv/lib/python3.10/site-packages (from sympy->torch!=1.12.0,>=1.9->transformers[torch]~=4.19->dynamicprompts[attentiongrabber,magicprompt]~=0.30.4) (1.3.0)
Using cached dynamicprompts-0.30.4-py3-none-any.whl (51 kB)
Installing collected packages: send2trash, dynamicprompts
Successfully installed dynamicprompts-0.30.4 send2trash-1.8.2
sd-dynamic-prompts installer: running /Volumes/Diffusion/webui/m3/venv/bin/python3.10 -m pip install 'send2trash~=1.8' 'dynamicprompts[attentiongrabber,magicprompt]~=0.30.4'
loading WD14-tagger reqs from /Volumes/Diffusion/webui/m3/extensions/stable-diffusion-webui-wd14-tagger/requirements.txt
Checking WD14-tagger requirements.
Launching Web UI with arguments: --skip-torch-cuda-test --skip-version-check --no-download-sd-model --upcast-sampling --no-half-vae --opt-sub-quad-attention --use-cpu interrogate --api --max-batch-count 250 --port 9595 --ckpt-dir /Volumes/Diffusion/Models/Reorg/Checkpoints --vae-dir /Volumes/Diffusion/Models/Library/VAE --embeddings-dir /Volumes/Diffusion/Models/Library/Embeddings --hypernetwork-dir /Volumes/Diffusion/Models/Library/Hypernetworks --esrgan-models-path /Volumes/Diffusion/Models/Library/ESRGAN --lora-dir /Volumes/Diffusion/Models/Library/Lora --cors-allow-origins=http://localhost:3456/
./webui.sh: line 256: 70305 Illegal instruction: 4  "${python_cmd}" -u "${LAUNCH_SCRIPT}" "$@"

I rm -rf venv __pycache__ and tried again. Same result. If I rm -rf extensions/stable-diffusion-webui-wd14-tagger then it starts up normally.

I cloned the tagger repo right before I tried running it, so it's fresh. I'm running on AUTOMATIC1111/stable-diffusion-webui master branch, currently up to date with origin (commit 3e068de0).

Other details

If there are any details I'm forgetting, please let me know what you need.

hal0thane commented 6 months ago

Update: I seem to be having problems with a lot of extensions right now. All the others are giving me segmentation faults, not illegal instructions, but I have previously used these same extensions just fine in the past on my older Intel Mac. The problem is likely not with Tagger, so I will close this now. If it turns out that all the others are resolved and this is still an issue, I'll reopen at that time.