frank-xwang / InstanceDiffusion

[CVPR 2024] Code release for "InstanceDiffusion: Instance-level Control for Image Generation"
https://people.eecs.berkeley.edu/~xdwang/projects/InstDiff/
Apache License 2.0
481 stars 25 forks source link

Can you privide a simple demo json for training your model #14

Closed zhengziqiang closed 6 months ago

zhengziqiang commented 6 months ago

Could you please provide a simple json file for training to let us know what kind of data structure is needed?

The json file could contain some meaningless placeholders. Just let us know the input structure is ok. Thank you for your help in advance

zhengziqiang commented 6 months ago

Because I am following your instructions.

I found no "Tag2Text" directory in GroundedSAM

line 29 in "dataset-generation/submitit_automatic_label_ram_save_json.py",

It is really confusing.

zhengziqiang commented 6 months ago

Really cannot run the data generation following your instructions. Could you please help with this? Or just provide some demo jsons?

frank-xwang commented 6 months ago

Hi, the third-party repo Grounded-SAM removed Tag2Text in their recent updates :-( . To use our old dataset generation code, you might need to clone an earlier version of GroundedSAM.

But good news! I've updated the InstanceDiffusion repo to support dataset generation with the latest Grounded-SAM version. Check out the updated guide in dataset-generation/README.md and see this commit for details on the changes made for compatibility with the latest GroundedSAM version.

Please don't hesitate to reach out with any further questions or issues.

zhengziqiang commented 6 months ago

Thank you for your help. The code can run successfully but I met the out-of-memory issue. I plan to do this step-by-step.

66ling66 commented 6 months ago

Hello do you get the training data successfully?

sweetDream6609 commented 2 months ago

Hello do you get the training data successfully?Could you please provide a simple json file for training to let us know what kind of data structure is needed?I am plan to generat data by myself.