search

kohya-ss / sd-scripts

Apache License 2.0
5.18k stars 861 forks source link

Сan't train LORA on Proteus v0.2 model #1095

Open alexv0iceh opened 9 months ago

alexv0iceh commented 9 months ago

I got the error when trying to start lora train with Playground V2 model How to fix it? Looks like an error due to Proteus' TE training, but I'm not sure.

https://civitai.com/models/267242/proteus Works for inference in a1, comfy, fooocus without changing anything.

ERROR: RuntimeError: Error(s) in loading state_dict for CLIPTextModel: Missing key(s) in state_dict: "text_model.embeddings.position_ids".

maybleMyers commented 8 months ago

You can train on top of this model:

https://civitai.com/models/224424?modelVersionId=255628

It has something unhooked to enable training. It is the closest thing to training on playground I have been able to accomplish.

kohya-ss commented 8 months ago

The model seems to have trained with newer transformer library. The latest version of the repo supports both version of transformer, so it will work now.