search

essunny310 / FreestyleNet

[CVPR 2023 Highlight] Freestyle Layout-to-Image Synthesis
https://essunny310.github.io/FreestyleNet/
MIT License
149 stars 3 forks source link

how to get json file that defines the mapping between text and layout. #9

Closed joanChen0212 closed 11 months ago

joanChen0212 commented 12 months ago

Excuse me , how to get json file that defines the mapping between text and layout if I want to generate images in a freestyle way?What is the label value?

essunny310 commented 12 months ago

The label value is associated with the pixel value of a region in the layout image. In short, you need to provide a description for each region in the layout, thus the mapping is defined as <"your description for a region": pixel value of that region in the layout>. Feel free to reach out if you have any further questions.

joanChen0212 commented 12 months ago

Thanks for your reply ! Could you please tell me what tool you used to get the pixel values for each region in the layout? Thank you a lot~

essunny310 commented 12 months ago

It depends on how you get the layout images. Those provided in ./examples/ are from COCO-Stuff dataset, and you can refer to this to obtain the pixel values.

joanChen0212 commented 11 months ago

Thanks for your reply ! your reply help me a lot!