frank-xwang / InstanceDiffusion

[CVPR 2024] Code release for "InstanceDiffusion: Instance-level Control for Image Generation"
https://people.eecs.berkeley.edu/~xdwang/projects/InstDiff/
Apache License 2.0
484 stars 25 forks source link

How to run the train code, I get the follwing error? Do I need to configure an additional environment to run #13

Closed heart-du closed 5 months ago

heart-du commented 7 months ago

Traceback (most recent call last): File "/home/ma-user/work/d00563493/code/InstanceDiffusion/run_with_submitit.py", line 123, in main() File "/home/ma-user/work/d00563493/code/InstanceDiffusion/run_with_submitit.py", line 83, in main args.job_dir = get_shared_folder() / "%j" File "/home/ma-user/work/d00563493/code/InstanceDiffusion/run_with_submitit.py", line 34, in get_shared_folder raise RuntimeError("No shared folder available")

frank-xwang commented 7 months ago

Hi, the shared folder should be the folder that is visible by all machines / nodes. You can change the path "/fsx-muvigen/" in line 30 to the shared folder in your env. You can also simply use your home directory if it is visible by all nodes.

heart-du commented 7 months ago

thanks for reply, I also want know how to get projection_matrix.

frank-xwang commented 6 months ago

Hi, projection_matrix (768*768) is the CLIP projection matrix, which should be weight.data of Linear layer defined in CLIP (out_dim, in_dim). We actually didn't use it in our codes.

frank-xwang commented 5 months ago

Closing this issue now. Please feel free to re-open it if you have further questions.