lllyasviel / ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1
4.48k stars 364 forks source link

Tile model training details #69

Open nikitabalabin opened 1 year ago

nikitabalabin commented 1 year ago

Could you please provide details on what data you used to train a tile model. Were it crops from big images? Did you use down-up resampling? And some other information.

dedoogong commented 11 months ago

I also have really big curiousity about how to train tiling model. is it similar to IF method? there are, I think, other different upscaling methods for getting clear, sharpt high resolution images like IF, SD x4 upscaler, SDXL 0.9(1.0 soon). I tried to img2img on SD x4 upscaler and Controlnet tile model and I think your model wins. what is the difference? how to prepare dataset for retraining? should I have 4K image and reduce the size and apply several blurring? that's all? then Controlnet will output bigger sized images while training?

onion-liu commented 11 months ago

@dedoogong what is IF method?

yuangpeng commented 10 months ago

@dedoogong what is IF method?

DeepFloyd IF (Imagen)

whlp-synth commented 8 months ago

Any new information about this topic?

geroldmeisinger commented 8 months ago

also see #125

zjysteven commented 1 month ago

In case anyone is still interested, I got controlnet tile training working, and the script is uploaded here https://github.com/zjysteven/controlnet_tile. test_screenshot