Picsart-AI-Research / StreamingT2V

StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text
https://streamingt2v.github.io/
1.42k stars 149 forks source link

RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format #61

Closed Willian7004 closed 2 months ago

Willian7004 commented 2 months ago

I used this model on a server and the program stopped with RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format after generated,should I set model.load_state_dict to False to skip it? The complete running process is as follows: root@notebook-1833146016868352001-scni0az45s-78860:~/StreamingT2V# cd code root@notebook-1833146016868352001-scni0az45s-78860:~/StreamingT2V/code# python inference_i2v.py --input ./input/1.png --output ./output Seed set to 33 model_index.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 496/496 [00:00<00:00, 2.35MB/s] vae/config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 607/607 [00:00<00:00, 1.80MB/s] scheduler/scheduler_config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 533/533 [00:00<00:00, 3.05MB/s] (…)ature_extractor/preprocessor_config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████| 518/518 [00:00<00:00, 1.30MB/s] unet/config.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 984/984 [00:00<00:00, 3.16MB/s] image_encoder/config.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 685/685 [00:00<00:00, 1.27MB/s] diffusion_pytorch_model.safetensors: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 391M/391M [04:16<00:00, 1.53MB/s] model.safetensors: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.53G/2.53G [19:50<00:00, 2.12MB/s] diffusion_pytorch_model.safetensors: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 6.10G/6.10G [32:56<00:00, 3.09MB/s] Fetching 9 files: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [32:57<00:00, 219.71s/it] Loading pipeline components...: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5/5 [00:00<00:00, 5.32it/s] Loading pipeline components...: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5/5 [00:00<00:00, 5.29it/s] --- START: Loading module: network_config --- --- FINSHED: Loading module: network_config --- --- START: Loading module: model --- --- FINSHED: Loading module: model --- --- START: Loading module: controlnet --- --- FINSHED: Loading module: controlnet --- --- START: Loading module: denoiser --- --- FINSHED: Loading module: denoiser --- --- START: Loading module: conditioner --- Warning: Seems object conditioner was not build correct. --- FINSHED: Loading module: conditioner --- --- START: Loading module: first_stage_model --- --- FINSHED: Loading module: first_stage_model --- --- START: Loading module: sampler --- --- FINSHED: Loading module: sampler --- --- START: Loading module: svd_pipeline --- diffusion_pytorch_model.fp16.safetensors: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 196M/196M [01:25<00:00, 2.28MB/s] model.fp16.safetensors: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.26G/1.26G [09:48<00:00, 2.15MB/s] diffusion_pytorch_model.fp16.safetensors: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3.05G/3.05G [16:27<00:00, 3.09MB/s] Fetching 9 files: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [16:28<00:00, 109.81s/it] Loading pipeline components...: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5/5 [00:00<00:00, 6.08it/s] --- FINSHED: Loading module: svd_pipeline --- Using 16bit Automatic Mixed Precision (AMP) GPU available: True (cuda), used: True TPU available: False, using: 0 TPU cores IPU available: False, using: 0 IPUs HPU available: False, using: 0 HPUs Downloading https://cdn-lfs-us-1.huggingface.co/repos/2c/85/2c8589e0eff2523f903a34e9dcd9d7ffa1d93f98e987fa365ff9c65d1f5ceb5c/9a6c2a0eb47ef323c8414ea5c08faf44336e0eb599b4e25c90f56f6f6261d65d?response-content-disposition=inline%3B+filename*%3DUTF-8%27%27model.safetensors%3B+filename%3D%22model.safetensors%22%3B&Expires=1726203395&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcyNjIwMzM5NX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzJjLzg1LzJjODU4OWUwZWZmMjUyM2Y5MDNhMzRlOWRjZDlkN2ZmYTFkOTNmOThlOTg3ZmEzNjVmZjljNjVkMWY1Y2ViNWMvOWE2YzJhMGViNDdlZjMyM2M4NDE0ZWE1YzA4ZmFmNDQzMzZlMGViNTk5YjRlMjVjOTBmNTZmNmY2MjYxZDY1ZD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=LrZBGtXATaEMR%7EfzXuNzpAWbNyp7vw0b2CVhLpbIL88Ss1YufEifnJ0CoakZRpWPT7urYvn375iZubhofQM5tm-qzBWBACTiLeTT-wlSq-cRSA%7E3DgKhxoDsNsmtvIUCjkfjtyRq9BT5g3Tldj998Ab4cuf-x1ieQWzrxkj0vfpv07DaGzh4veP1rwRme1YOLjzOLwSJdpFIftwZwPy1OKr5v8FCXG%7E0UhOm5txfcN%7ESDNsiEML1hX-cbvBdazMmXxUyEYkrvmCt81qHqwOBok7ja2I583KRLWGmXUuHXDucJiXj%7EFrOAhDbznCJG8RVUtmjTqnq88h3l4WWbxweTA__&Key-Pair-Id=K24J24Z295AEI9 to checkpoint/StreamingSVD/model.safetensors 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 12527386656/12527386656 [2:15:08<00:00, 1544976.41it/s] LOADING TRAINED WEIGHTS Traceback (most recent call last): File "/root/StreamingT2V/code/inference_i2v.py", line 216, in generator = StreamingPipeline() File "/root/StreamingT2V/code/inference_i2v.py", line 62, in init return_dict = self.init_model(cli) File "/root/StreamingT2V/code/inference_i2v.py", line 136, in init_model model.load_state_dict(ckpt) # load trained model File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2152, in load_state_dict raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format( RuntimeError: Error(s) in loading state_dict for StreamingSVD: Unexpected key(s) in state_dict: "conditioner.embedders.0.open_clip.model.ln_final.bias", "conditioner.embedders.0.open_clip.model.ln_final.weight", "conditioner.embedders.0.open_clip.model.logit_scale", "conditioner.embedders.0.open_clip.model.positional_embedding", "conditioner.embedders.0.open_clip.model.text_projection", "conditioner.embedders.0.open_clip.model.token_embedding.weight", "conditioner.embedders.0.open_clip.model.visual.class_embedding", "conditioner.embedders.0.open_clip.model.visual.conv1.weight", "conditioner.embedders.0.open_clip.model.visual.ln_post.bias", "conditioner.embedders.0.open_clip.model.visual.ln_post.weight", "conditioner.embedders.0.open_clip.model.visual.ln_pre.bias", "conditioner.embedders.0.open_clip.model.visual.ln_pre.weight", "conditioner.embedders.0.open_clip.model.visual.positional_embedding", "conditioner.embedders.0.open_clip.model.visual.proj", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.0.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.1.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.10.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.11.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.12.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.13.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.14.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.15.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.16.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.17.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.18.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.19.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.2.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.20.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.21.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.22.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.23.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.24.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.25.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.26.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.27.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.28.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.29.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.3.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.30.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.31.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.4.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.5.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.6.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.7.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.8.mlp.c_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.attn.in_proj_bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.attn.in_proj_weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.attn.out_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.attn.out_proj.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.ln_1.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.ln_1.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.ln_2.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.ln_2.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.mlp.c_fc.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.mlp.c_fc.weight", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.mlp.c_proj.bias", "conditioner.embedders.0.open_clip.model.visual.transformer.resblocks.9.mlp.c_proj.weight", "conditioner.embedders.3.encoder.decoder.conv_in.bias", "conditioner.embedders.3.encoder.decoder.conv_in.weight", "conditioner.embedders.3.encoder.decoder.conv_out.bias", "conditioner.embedders.3.encoder.decoder.conv_out.weight", "conditioner.embedders.3.encoder.decoder.mid.attn_1.k.bias", "conditioner.embedders.3.encoder.decoder.mid.attn_1.k.weight", "conditioner.embedders.3.encoder.decoder.mid.attn_1.norm.bias", "conditioner.embedders.3.encoder.decoder.mid.attn_1.norm.weight", "conditioner.embedders.3.encoder.decoder.mid.attn_1.proj_out.bias", "conditioner.embedders.3.encoder.decoder.mid.attn_1.proj_out.weight", "conditioner.embedders.3.encoder.decoder.mid.attn_1.q.bias", "conditioner.embedders.3.encoder.decoder.mid.attn_1.q.weight", "conditioner.embedders.3.encoder.decoder.mid.attn_1.v.bias", "conditioner.embedders.3.encoder.decoder.mid.attn_1.v.weight", "conditioner.embedders.3.encoder.decoder.mid.block_1.conv1.bias", "conditioner.embedders.3.encoder.decoder.mid.block_1.conv1.weight", "conditioner.embedders.3.encoder.decoder.mid.block_1.conv2.bias", "conditioner.embedders.3.encoder.decoder.mid.block_1.conv2.weight", "conditioner.embedders.3.encoder.decoder.mid.block_1.norm1.bias", "conditioner.embedders.3.encoder.decoder.mid.block_1.norm1.weight", "conditioner.embedders.3.encoder.decoder.mid.block_1.norm2.bias", "conditioner.embedders.3.encoder.decoder.mid.block_1.norm2.weight", "conditioner.embedders.3.encoder.decoder.mid.block_2.conv1.bias", "conditioner.embedders.3.encoder.decoder.mid.block_2.conv1.weight", "conditioner.embedders.3.encoder.decoder.mid.block_2.conv2.bias", "conditioner.embedders.3.encoder.decoder.mid.block_2.conv2.weight", "conditioner.embedders.3.encoder.decoder.mid.block_2.norm1.bias", "conditioner.embedders.3.encoder.decoder.mid.block_2.norm1.weight", "conditioner.embedders.3.encoder.decoder.mid.block_2.norm2.bias", "conditioner.embedders.3.encoder.decoder.mid.block_2.norm2.weight", "conditioner.embedders.3.encoder.decoder.norm_out.bias", "conditioner.embedders.3.encoder.decoder.norm_out.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.0.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.0.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.0.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.0.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.0.nin_shortcut.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.0.nin_shortcut.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.0.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.0.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.0.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.0.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.1.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.1.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.1.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.1.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.1.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.1.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.1.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.1.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.2.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.2.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.2.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.2.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.2.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.2.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.0.block.2.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.0.block.2.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.0.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.0.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.0.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.0.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.0.nin_shortcut.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.0.nin_shortcut.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.0.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.0.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.0.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.0.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.1.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.1.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.1.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.1.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.1.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.1.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.1.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.1.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.2.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.2.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.2.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.2.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.2.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.2.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.1.block.2.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.1.block.2.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.1.upsample.conv.bias", "conditioner.embedders.3.encoder.decoder.up.1.upsample.conv.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.0.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.0.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.0.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.0.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.0.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.0.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.0.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.0.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.1.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.1.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.1.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.1.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.1.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.1.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.1.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.1.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.2.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.2.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.2.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.2.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.2.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.2.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.2.block.2.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.2.block.2.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.2.upsample.conv.bias", "conditioner.embedders.3.encoder.decoder.up.2.upsample.conv.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.0.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.0.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.0.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.0.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.0.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.0.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.0.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.0.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.1.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.1.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.1.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.1.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.1.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.1.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.1.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.1.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.2.conv1.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.2.conv1.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.2.conv2.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.2.conv2.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.2.norm1.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.2.norm1.weight", "conditioner.embedders.3.encoder.decoder.up.3.block.2.norm2.bias", "conditioner.embedders.3.encoder.decoder.up.3.block.2.norm2.weight", "conditioner.embedders.3.encoder.decoder.up.3.upsample.conv.bias", "conditioner.embedders.3.encoder.decoder.up.3.upsample.conv.weight", "conditioner.embedders.3.encoder.encoder.conv_in.bias", "conditioner.embedders.3.encoder.encoder.conv_in.weight", "conditioner.embedders.3.encoder.encoder.conv_out.bias", "conditioner.embedders.3.encoder.encoder.conv_out.weight", "conditioner.embedders.3.encoder.encoder.down.0.block.0.conv1.bias", "conditioner.embedders.3.encoder.encoder.down.0.block.0.conv1.weight", "conditioner.embedders.3.encoder.encoder.down.0.block.0.conv2.bias", "conditioner.embedders.3.encoder.encoder.down.0.block.0.conv2.weight", "conditioner.embedders.3.encoder.encoder.down.0.block.0.norm1.bias", "conditioner.embedders.3.encoder.encoder.down.0.block.0.norm1.weight", "conditioner.embedders.3.encoder.encoder.down.0.block.0.norm2.bias", "conditioner.embedders.3.encoder.encoder.down.0.block.0.norm2.weight", "conditioner.embedders.3.encoder.encoder.down.0.block.1.conv1.bias", "conditioner.embedders.3.encoder.encoder.down.0.block.1.conv1.weight", "conditioner.embedders.3.encoder.encoder.down.0.block.1.conv2.bias", "conditioner.embedders.3.encoder.encoder.down.0.block.1.conv2.weight", "conditioner.embedders.3.encoder.encoder.down.0.block.1.norm1.bias", "conditioner.embedders.3.encoder.encoder.down.0.block.1.norm1.weight", "conditioner.embedders.3.encoder.encoder.down.0.block.1.norm2.bias", "conditioner.embedders.3.encoder.encoder.down.0.block.1.norm2.weight", "conditioner.embedders.3.encoder.encoder.down.0.downsample.conv.bias", "conditioner.embedders.3.encoder.encoder.down.0.downsample.conv.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.0.conv1.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.0.conv1.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.0.conv2.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.0.conv2.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.0.nin_shortcut.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.0.nin_shortcut.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.0.norm1.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.0.norm1.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.0.norm2.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.0.norm2.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.1.conv1.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.1.conv1.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.1.conv2.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.1.conv2.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.1.norm1.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.1.norm1.weight", "conditioner.embedders.3.encoder.encoder.down.1.block.1.norm2.bias", "conditioner.embedders.3.encoder.encoder.down.1.block.1.norm2.weight", "conditioner.embedders.3.encoder.encoder.down.1.downsample.conv.bias", "conditioner.embedders.3.encoder.encoder.down.1.downsample.conv.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.0.conv1.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.0.conv1.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.0.conv2.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.0.conv2.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.0.nin_shortcut.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.0.nin_shortcut.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.0.norm1.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.0.norm1.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.0.norm2.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.0.norm2.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.1.conv1.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.1.conv1.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.1.conv2.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.1.conv2.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.1.norm1.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.1.norm1.weight", "conditioner.embedders.3.encoder.encoder.down.2.block.1.norm2.bias", "conditioner.embedders.3.encoder.encoder.down.2.block.1.norm2.weight", "conditioner.embedders.3.encoder.encoder.down.2.downsample.conv.bias", "conditioner.embedders.3.encoder.encoder.down.2.downsample.conv.weight", "conditioner.embedders.3.encoder.encoder.down.3.block.0.conv1.bias", "conditioner.embedders.3.encoder.encoder.down.3.block.0.conv1.weight", "conditioner.embedders.3.encoder.encoder.down.3.block.0.conv2.bias", "conditioner.embedders.3.encoder.encoder.down.3.block.0.conv2.weight", "conditioner.embedders.3.encoder.encoder.down.3.block.0.norm1.bias", "conditioner.embedders.3.encoder.encoder.down.3.block.0.norm1.weight", "conditioner.embedders.3.encoder.encoder.down.3.block.0.norm2.bias", "conditioner.embedders.3.encoder.encoder.down.3.block.0.norm2.weight", "conditioner.embedders.3.encoder.encoder.down.3.block.1.conv1.bias", "conditioner.embedders.3.encoder.encoder.down.3.block.1.conv1.weight", "conditioner.embedders.3.encoder.encoder.down.3.block.1.conv2.bias", "conditioner.embedders.3.encoder.encoder.down.3.block.1.conv2.weight", "conditioner.embedders.3.encoder.encoder.down.3.block.1.norm1.bias", "conditioner.embedders.3.encoder.encoder.down.3.block.1.norm1.weight", "conditioner.embedders.3.encoder.encoder.down.3.block.1.norm2.bias", "conditioner.embedders.3.encoder.encoder.down.3.block.1.norm2.weight", "conditioner.embedders.3.encoder.encoder.mid.attn_1.k.bias", "conditioner.embedders.3.encoder.encoder.mid.attn_1.k.weight", "conditioner.embedders.3.encoder.encoder.mid.attn_1.norm.bias", "conditioner.embedders.3.encoder.encoder.mid.attn_1.norm.weight", "conditioner.embedders.3.encoder.encoder.mid.attn_1.proj_out.bias", "conditioner.embedders.3.encoder.encoder.mid.attn_1.proj_out.weight", "conditioner.embedders.3.encoder.encoder.mid.attn_1.q.bias", "conditioner.embedders.3.encoder.encoder.mid.attn_1.q.weight", "conditioner.embedders.3.encoder.encoder.mid.attn_1.v.bias", "conditioner.embedders.3.encoder.encoder.mid.attn_1.v.weight", "conditioner.embedders.3.encoder.encoder.mid.block_1.conv1.bias", "conditioner.embedders.3.encoder.encoder.mid.block_1.conv1.weight", "conditioner.embedders.3.encoder.encoder.mid.block_1.conv2.bias", "conditioner.embedders.3.encoder.encoder.mid.block_1.conv2.weight", "conditioner.embedders.3.encoder.encoder.mid.block_1.norm1.bias", "conditioner.embedders.3.encoder.encoder.mid.block_1.norm1.weight", "conditioner.embedders.3.encoder.encoder.mid.block_1.norm2.bias", "conditioner.embedders.3.encoder.encoder.mid.block_1.norm2.weight", "conditioner.embedders.3.encoder.encoder.mid.block_2.conv1.bias", "conditioner.embedders.3.encoder.encoder.mid.block_2.conv1.weight", "conditioner.embedders.3.encoder.encoder.mid.block_2.conv2.bias", "conditioner.embedders.3.encoder.encoder.mid.block_2.conv2.weight", "conditioner.embedders.3.encoder.encoder.mid.block_2.norm1.bias", "conditioner.embedders.3.encoder.encoder.mid.block_2.norm1.weight", "conditioner.embedders.3.encoder.encoder.mid.block_2.norm2.bias", "conditioner.embedders.3.encoder.encoder.mid.block_2.norm2.weight", "conditioner.embedders.3.encoder.encoder.norm_out.bias", "conditioner.embedders.3.encoder.encoder.norm_out.weight", "conditioner.embedders.3.encoder.post_quant_conv.bias", "conditioner.embedders.3.encoder.post_quant_conv.weight", "conditioner.embedders.3.encoder.quant_conv.bias", "conditioner.embedders.3.encoder.quant_conv.weight". root@notebook-1833146016868352001-scni0az45s-78860:~/StreamingT2V/code#

rob-hen commented 2 months ago

Hi @Willian7004,

please check https://github.com/Picsart-AI-Research/StreamingT2V/issues/59 first.