search

d8ahazard / sd_dreambooth_extension

Other
1.86k stars 281 forks source link

[Bug]: Exception training model: 'intercept_args() got an unexpected keyword argument 'multiprocessing_context''. #1316

Closed assafna closed 1 year ago

assafna commented 1 year ago

Is there an existing issue for this?

What happened?

After generating the class images and before training started I recieved the following error in the web UI of A1111: Exception training model: 'intercept_args() got an unexpected keyword argument 'multiprocessing_context''.

Steps to reproduce the problem

Nothing special that I did

Commit and libraries

Initializing Dreambooth Dreambooth revision: c2a5617c587b812b5a408143ddfb18fc49234edf Successfully installed accelerate-0.19.0 fastapi-0.94.1 gitpython-3.1.32 transformers-4.30.2

Does your project take forever to startup? Repetitive dependency installation may be the reason. Automatic1111's base project sets strict requirements on outdated dependencies. If an extension is using a newer version, the dependency is uninstalled and reinstalled twice every startup.

[+] xformers version 0.0.20 installed. [+] torch version 2.0.1+cu118 installed. [+] torchvision version 0.15.2+cu118 installed. [+] accelerate version 0.19.0 installed. [+] diffusers version 0.16.1 installed. [+] transformers version 4.30.2 installed. [+] bitsandbytes version 0.35.4 installed.

Command Line Arguments

--api --xformers --update-check --update-all-extensions --autolaunch

Console logs

Initializing dreambooth training...
                                                                 2023-08-07 13:20:18,568 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"                                                                                                                                                                                                             | 0/330 [00:00<?, ?it/s]
2023-08-07 13:20:18,571 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
                                                                 2023-08-07 13:20:19,517 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2023-08-07 13:20:19,520 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
Pre-processing images: classifiers_0: : 360it [00:01, 206.64it/s]
Nothing to generate./1:   0%|▋                                                                                                                                                                                                                                             | 1/330 [00:01<09:32,  1.74s/it]
                                                                                                                                                                                                                                                                                                           2023-08-07 13:20:20,423 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"                                                                                                                                                     | 0/330 [00:00<?, ?it/s]
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2023-08-07 13:20:20,426 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2023-08-07 13:20:21,372 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2023-08-07 13:20:21,379 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
Enabling xformers memory efficient attention for unet
Enabling xformers memory efficient attention for unet
2023-08-07 13:20:22,448 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2023-08-07 13:20:22,451 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
                                                                                                                                                                                                                                                                                                           Found 300 reg images.%|                                                                                                                                                                                                                                                             | 0/330 [00:00<?, ?it/s]
Preparing dataset...
Init dataset!
Preparing Dataset (With Caching)
                                                                                                                                                                                                                                                                                                           Loading cached latents...|                                                                                                                                                                                                                                                          | 0/330 [00:00<?, ?it/s]
Bucket 0 (512, 512, 0) - Instance Images: 30 | Class Images: 300 | Max Examples/batch:  60
Total Buckets 1 - Instance Images: 30 | Class Images: 300 | Max Examples/batch:  60

Total images / batch: 60, total examples: 60██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 330/330 [00:00<00:00, 13737.76it/s]
                                                                                                                                                                                                                                                                                                           Total dataset length (steps): 60
                  Initializing bucket counter!
2023-08-07 13:20:23,515 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2023-08-07 13:20:23,518 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
Traceback (most recent call last):
  File "D:\Tools\stable-diffusion-webui\extensions\sd_dreambooth_extension\dreambooth\ui_functions.py", line 729, in start_training
    result = main(class_gen_method=class_gen_method)
  File "D:\Tools\stable-diffusion-webui\extensions\sd_dreambooth_extension\dreambooth\train_dreambooth.py", line 1548, in main
    return inner_loop()
  File "D:\Tools\stable-diffusion-webui\extensions\sd_dreambooth_extension\dreambooth\memory.py", line 119, in decorator
    return function(batch_size, grad_size, prof, *args, **kwargs)
  File "D:\Tools\stable-diffusion-webui\extensions\sd_dreambooth_extension\dreambooth\train_dreambooth.py", line 610, in inner_loop
    ) = accelerator.prepare(
  File "D:\Tools\stable-diffusion-webui\venv\lib\site-packages\accelerate\accelerator.py", line 1143, in prepare
    result = tuple(
  File "D:\Tools\stable-diffusion-webui\venv\lib\site-packages\accelerate\accelerator.py", line 1144, in <genexpr>
    self._prepare_one(obj, first_pass=True, device_placement=d) for obj, d in zip(args, device_placement)
  File "D:\Tools\stable-diffusion-webui\venv\lib\site-packages\accelerate\accelerator.py", line 993, in _prepare_one
    return self.prepare_data_loader(obj, device_placement=device_placement)
  File "D:\Tools\stable-diffusion-webui\venv\lib\site-packages\accelerate\accelerator.py", line 1639, in prepare_data_loader
    prepared_data_loader = prepare_data_loader(
  File "D:\Tools\stable-diffusion-webui\venv\lib\site-packages\accelerate\data_loader.py", line 753, in prepare_data_loader
    dataloader = DataLoaderShard(
  File "D:\Tools\stable-diffusion-webui\venv\lib\site-packages\accelerate\data_loader.py", line 360, in __init__
    super().__init__(dataset, **kwargs)
TypeError: intercept_args() got an unexpected keyword argument 'multiprocessing_context'
0it [00:01, ?it/s]
2023-08-07 13:20:24,836 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2023-08-07 13:20:24,842 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
Restored system models.
Duration: 00:00:07
2023-08-07 13:20:25,001 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2023-08-07 13:20:25,005 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2023-08-07 13:20:25,801 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2023-08-07 13:20:25,804 - _client.py [line:1729] - INFO: HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"

Additional information

No response

prankousky commented 1 year ago

Experiencing the same issue.

github-actions[bot] commented 1 year ago

This issue is stale because it has been open 5 days with no activity. Remove stale label or comment or this will be closed in 5 days

joezk commented 1 year ago

same issue here, anyone please have solution ? even re-install dreambooth didn't solve it

prankousky commented 1 year ago

I re-installed everything (automatic111 and dreambooth) in a fresh path. Still the same issue.