lllyasviel / sd-forge-layerdiffuse

[WIP] Layer Diffusion for WebUI (via Forge)
Apache License 2.0
3.79k stars 327 forks source link

Problems with Iterative Generation #83

Open DuoLi1999 opened 6 months ago

DuoLi1999 commented 6 months ago

I've been extensively experimenting with this incredible project and have found most implementations to function seamlessly. However, I've encountered several issues specifically related to iteration generation that I hope to get some guidance on or report for potential fixes.

Object Positioning in Iterations: It appears that the model struggles to modify the position of objects in accordance with the prompts provided. The objects are always generated in the middle of the image during my observation.

Background Fidelity Across Iterations: I've observed that the background tends to become faded or lose detail during the iterative process, a phenomenon that can be detected even within a single iteration cycle.

Unexpected Object Generation: When using prompts that specify object relationships, such as 'box in front of man' or 'a book in front of a cat', the model occasionally introduces extra, unintended objects into the scene, which you can see in the pictures below.

Given these observations, I'm wondering if there might be adjustments I could make on my end to mitigate these issues, or if they are known limitations or bugs within the model itself.

image