Sherrylone / PQDiff

[ICLR 2024] Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approach Link: https://arxiv.org/abs/2401.15652
65 stars 1 forks source link

Inference using the weights #13

Open ac5113 opened 1 month ago

ac5113 commented 1 month ago

Hello, Is there a way to perform inference on a single image/ directory of images using the provided weights?

bhosalems commented 1 month ago

Yes, I was also searching for this.

ustczhouyu commented 3 weeks ago

Hello, Is there a way to perform inference on a single image/ directory of images using the provided weights?

have you solved this issue? I want to know why are the images in the gen folder generated by evaluate.py during the sampling stage colorful and noisy images?

ustczhouyu commented 3 weeks ago

Yes, I was also searching for this.

have you solved this issue? I want to know why are the images in the gen folder generated by evaluate.py during the sampling stage colorful and noisy images?

ac5113 commented 3 weeks ago

Hello, Is there a way to perform inference on a single image/ directory of images using the provided weights?

have you solved this issue? I want to know why are the images in the gen folder generated by evaluate.py during the sampling stage colorful and noisy images?

No, I didn't look at it anymore after raising the issue

ustczhouyu commented 3 weeks ago

Hello, Is there a way to perform inference on a single image/ directory of images using the provided weights?

have you solved this issue? I want to know why are the images in the gen folder generated by evaluate.py during the sampling stage colorful and noisy images?

No, I didn't look at it anymore after raising the issue

can you use this command? python3 -m torch.distributed.launch --nproc_per_node=8 \ --node_rank 0 \ --master_addr=${MASTER_ADDR:-127.0.0.1} \ --master_port=${MASTER_PORT:-46123} \ evaluate.py --target_expansion 0.25 0.25 0.25 0.25 --eval_dir ./eval_dir/scenery/1x/ --size 128 \ --config flickr192_large

Sherrylone commented 3 weeks ago

In the previous issue, we discovered that this checkpoint might not be successfully loaded during the evaluation process. This could be due to some structural errors that occurred when uploading from local storage to the server. If possible, please retrain it from scratch (8 V100 GPUs or 4 A100 GPUs should be sufficient to complete the task).

ustczhouyu commented 3 weeks ago

In the previous issue, we discovered that this checkpoint might not be successfully loaded during the evaluation process. This could be due to some structural errors that occurred when uploading from local storage to the server. If possible, please retrain it from scratch (8 V100 GPUs or 4 A100 GPUs should be sufficient to complete the task).

when I run :accelerate launch --multi_gpu --num_processes 8 --mixed_precision fp16 train_ldm.py --config=configs/flickr192_large.py, I get the error: packaging.version.InvalidVersion: Invalid version: '0.10.1,<0.11', I tend to solve this issue by: pip install packaging==21.3 and pip install 'torchmetrics<0.8', but this error still arises.

Sherrylone commented 3 weeks ago

You can follow the installation of U-ViT https://github.com/baofff/U-ViT.

ustczhouyu commented 3 weeks ago

You can follow the installation of U-ViT https://github.com/baofff/U-ViT.

Thank you for your prompt reply. When the environment is ok, I run accelerate launch --multi_gpu --num_processes 8 --mixed_precision fp16 train_ldm.py --config=configs/flickr192_large.py, and it prints distributed_c10d.py:450] Waiting in store based barrier to initialize process group for rank: 4, key: store_based_barrier_key:1 (world_size=8, worker_count=19, timeout=0:30:00) all the time. How to solve it?

ustczhouyu commented 3 weeks ago

You can follow the installation of U-ViT https://github.com/baofff/U-ViT.

你好,还有一个问题,target_expansion具体如何设置,例如我想将输入图outpainting到2倍大小,target_expansion应该设置为多少?是否支持只在某个方向outpainting?