search

TencentARC / BrushNet

[ECCV 2024] The official implementation of paper "BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion"
https://tencentarc.github.io/BrushNet/
Other
1.36k stars 114 forks source link

Create Custom BrushData set. #29

Closed Shuvo001 closed 4 months ago

Shuvo001 commented 4 months ago

Thanks for your novel work! I would like to fine-tune your model on my custom dataset. But in this repo there have no detail information about how to create my own BurshData set. I have downloaded few files from and when i have extracted i have seen something like this: brushdata

So i am quite confused how can i convert my (image,masks,caption) to this format! I will really appreciate if you give me some informations about it, Thanks!!

juxuan27 commented 4 months ago

Hi, we use webdataset to store the data. You may refer to this.

SmileTAT commented 1 month ago

How do you get the description, by describing the local bbox or the segmentation map? @Shuvo001

zhangyonle commented 2 weeks ago

Thanks for your novel work! I would like to fine-tune your model on my custom dataset. But in this repo there have no detail information about how to create my own BurshData set. I have downloaded few files from and when i have extracted i have seen something like this: brushdata

So i am quite confused how can i convert my (image,masks,caption) to this format! I will really appreciate if you give me some informations about it, Thanks!!

Hello, I have original image (.png), corrseponding mask image (.png), and 5 captions every image, How can I convert them to these format as shown in this picture like xx.aesthetic_score, xx.caption, xx.height, xx.image, xx.original_key, xx.segmentation, xx.url, xx.width,

jayhxmo commented 2 weeks ago

+1 on @zhangyonle's question.