search

lllyasviel / Fooocus

Focus on prompting and generating
GNU General Public License v3.0
40.24k stars 5.58k forks source link

image HDRI #1648

Open disainerus opened 8 months ago

disainerus commented 8 months ago

Hello. I want to create the interior of rooms. Can your project make (or will it make in the future) a panoramic image HDRI from the middle of such a room for use in 3D program (for example, 3D max or Blender or Three JS).

mashb1t commented 8 months ago

Currently Fooocus can not create this kind of images. I am not aware of any possibility to also make them consistent as SDXL has been trainned on specific 1024*1024 and derivates in aspect ratios with the same sum of pixels, which means it will start to repeat elements if the image differs too much from the trained resolutions. You can find more information here: https://github.com/lllyasviel/Fooocus/pull/1617

Fooocus might have a feature in the future when a new model supporting higher resolution is published. For now, you can keep extending images with outpaint to one direction (left or right), but consistency is not guaranteed.

Does this answer your question?

disainerus commented 8 months ago

Yes, thank you

disainerus commented 8 months ago

I'm sorry, maybe I didn't ask the question quite right. I am interested in a panoramic image (as in the attached file). Currently, this is done by the resource https://skybox.blockadelabs.com/ But it is more intended for outdoor use. павильон 5

mashb1t commented 8 months ago

Currently Fooocus can not create this kind of images.

Panoramic image generation is not (yet) possible in Fooocus.

disainerus commented 8 months ago

Ok, thank you

barepixels commented 7 months ago

Yes, you can do it in Fooocus (SDXL). The trick is to render 1408x704 then upscale and use this Lora https://huggingface.co/artificialguybr/360Redmond

Here is a tutorial https://www.reddit.com/r/StableDiffusion/comments/16csnfr/workflow_creating_a_360_panorama_image_or_video/

But I advice you to do it with SD1.5 (a111) because of this handy extension (have not been updated in 2 years) https://github.com/tjm35/asymmetric-tiling-sd-webui

What it does is auto blend the far left edge to the far right edge seemless and avoid this problem if choose SDXL route

seems

f you choose to go with SD1.5 route then use this Lora https://civitai.com/models/10753/latentlabs360 and render at 1024x512

related link https://www.reddit.com/r/StableDiffusion/comments/1amvtoc/today_i_experimented_a_lot_to_generate_360/ https://www.reddit.com/r/StableDiffusion/comments/1amxmba/so_i_keep_experimenting_with_360_panoramic_images/ https://www.reddit.com/r/StableDiffusion/comments/1ao8pwb/i_keep_experimenting_with_360_panoramic_views/

wish someone would port this https://github.com/tjm35/asymmetric-tiling-sd-webui to SDXL

disainerus commented 7 months ago

Ok, thank you very much, I will study and try