Model Specific Error?

[AriannaHeartbell]

I'm encountering an error when trying to train using a recently uploaded model on Civitai (https://civitai.com/models/833294?modelVersionId=968495). The following error occurs:

Traceback (most recent call last):
  File "/content/kohya-trainer/train_network_xl_wrapper.py", line 10, in <module>
    trainer.train(args)
  File "/content/kohya-trainer/train_network.py", line 213, in train
    model_version, text_encoder, vae, unet = self.load_target_model(args, weight_dtype, accelerator)
  File "/content/kohya-trainer/sdxl_train_network.py", line 34, in load_target_model
    ) = sdxl_train_util.load_target_model(args, accelerator, sdxl_model_util.MODEL_VERSION_SDXL_BASE_V0_9, weight_dtype)
  File "/content/kohya-trainer/library/sdxl_train_util.py", line 33, in load_target_model
    ) = *load*target_model(
  File "/content/kohya-trainer/library/sdxl_train_util.py", line 70, in *load*target_model
    ) = sdxl_model_util.load_models_from_sdxl_checkpoint(model_version, name_or_path, device, weight_dtype)
  File "/content/kohya-trainer/library/sdxl_model_util.py", line 260, in load_models_from_sdxl_checkpoint
    info1 = text_model1.load_state_dict(te1_sd)
  File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 2215, in load_state_dict
    raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for CLIPTextModel:
    Missing key(s) in state_dict: "text_model.embeddings.position_ids".

Meanwhile, when using same settng but load_diffusers for a diffusers version of the model, I get the following error:

Traceback (most recent call last):
  File "/content/kohya-trainer/train_network_xl_wrapper.py", line 10, in <module>
    trainer.train(args)
  File "/content/kohya-trainer/train_network.py", line 213, in train
    model_version, text_encoder, vae, unet = self.load_target_model(args, weight_dtype, accelerator)
  File "/content/kohya-trainer/sdxl_train_network.py", line 34, in load_target_model
    ) = sdxl_train_util.load_target_model(args, accelerator, sdxl_model_util.MODEL_VERSION_SDXL_BASE_V0_9, weight_dtype)
  File "/content/kohya-trainer/library/sdxl_train_util.py", line 33, in load_target_model
    ) = loadtarget_model(
  File "/content/kohya-trainer/library/sdxl_train_util.py", line 79, in loadtarget_model
    pipe = StableDiffusionXLPipeline.from_pretrained(name_or_path, torch_dtype=weight_dtype, variant=variant, tokenizer=None)
  File "/usr/local/lib/python3.10/dist-packages/diffusers/pipelines/pipeline_utils.py", line 1253, in from_pretrained
    loaded_sub_model = load_sub_model(
  File "/usr/local/lib/python3.10/dist-packages/diffusers/pipelines/pipeline_utils.py", line 418, in load_sub_model
    class_obj, class_candidates = get_class_obj_and_candidates(
  File "/usr/local/lib/python3.10/dist-packages/diffusers/pipelines/pipeline_utils.py", line 326, in get_class_obj_and_candidates
    class_obj = getattr(library, class_name)
  File "/usr/local/lib/python3.10/dist-packages/diffusers/utils/import_utils.py", line 703, in getattr
    raise AttributeError(f"module {self.name} has no attribute {name}")
AttributeError: module diffusers has no attribute EDMDPMSolverMultistepScheduler

The above warning seems to have been resolved by upgrading diffusers to the latest version. However, I also get this warning I don't know how to handle:

The deprecation tuple ('no variant default', '0.24.0', 
"You are trying to load the model files of the variant=fp16, but no such modeling files are available. 
The default model files: 
{
    'text_encoder/model.safetensors', 
    'text_encoder_2/model.safetensors', 
    'vae/diffusion_pytorch_model.safetensors', 
    'unet/diffusion_pytorch_model.safetensors'
} 
will be loaded instead. Make sure to not load from variant=fp16 if such variant modeling files are not available. 
Doing so will lead to an error in v0.24.0 as defaulting to non-variant modeling files is deprecated.") 

( I tried diffusers version into 0.23.0 but I faced above EDMPMSolver~ issue)

Other sdxl models or non-v-prediction versions of this model (https://civitai.com/models/833294?modelVersionId=932238) train without any issues.

[hollowstrawberry]

I should investigate the parameters needed for a v-prediction model