search

boschresearch / ALDM

Official implementation of "Adversarial Supervision Makes Layout-to-Image Diffusion Models Thrive" (ICLR 2024)
https://yumengli007.github.io/ALDM/
GNU Affero General Public License v3.0
52 stars 3 forks source link

Out-of-distribution generation #7

Closed CeMOS-Abdullah closed 6 months ago

CeMOS-Abdullah commented 6 months ago

Is it possible to generate out-of-distribution samples using custom colormaps without the need to finetune(similar to the FreestyleNet implementation here: https://github.com/essunny310/FreestyleNet)?

According to my understanding of the codebase, the inference seems to be limited to only the colormaps defined in the dataloader modules for the respective datasets (coco-stuff/ADE20K/Cityscapes).

If yes, could you provide an example, or outline the steps needed to implement this feature?

Thanks in advance!

YumengLi007 commented 6 months ago

Hi @CeMOS-Abdullah , the input label map condition is constrained to the classes defined in the dataloaders. However, one can still change the prompt to generate out-of-distribution samples, e.g., different weather conditions, a burning van, as shown in the paper.

CeMOS-Abdullah commented 6 months ago

Thank you very much for your reply.