gligen / GLIGEN

Open-Set Grounded Text-to-Image Generation
MIT License
1.91k stars 145 forks source link

how to load other safetensors model instead sd1.5 #54

Open zengjie617789 opened 9 months ago

zengjie617789 commented 9 months ago

When I wanna try to changed the base1.4 model to 1.5, it worked successfully. furthermore I wanna try to load other model like RealisticV51 but I donot want to convert it to ckpt formart, so I load it by safetensors format. After that, I found the date in safetensors lack of somthing in ckpt format model. as the screenshoot below, the safetensors lack of the data which key named diffusion. image

RanJason-Code commented 9 months ago

i have the same question.Have you solved it? @zengjie617789

zengjie617789 commented 9 months ago

I donot know what the diffusion data means and i found much safetensors model which also lack of the data. I finally use the data in SD1.5 to replace the empty data.

zengjie617789 commented 9 months ago

After training about 2 days, the latest results is like below, which based on the RealisticV51. the prompt is that a asian man sitting next to a girl, two phases are a asian man and a girl. 42 45 as you can see, the results are not correspond with the coordinates.

ysy31415 commented 7 months ago

Hi, may i know which dataset was used in your training? and how many steps as well?