search

IDEA-Research / HumanSD

[ICCV 2023] The official implementation of paper "HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generation"
Apache License 2.0
269 stars 17 forks source link

Questions on Evaluation Metrics #28

Open VicZlq opened 9 months ago

VicZlq commented 9 months ago

Thank you very much for your work, we recently tried to add your work for comparison but had some problems with the assessment indicators.

Do you have a reference code for Pose Cosine Similarity-based AP (CAP) and People Count Error (PCE) ? We would like to ensure consistency of values. Thank you very much!:)

VicZlq commented 9 months ago

Thank you very much for your work, we recently tried to add your work for comparison but had some problems with the assessment indicators.

Do you have a reference code for Pose Cosine Similarity-based AP (CAP) and People Count Error (PCE) ? We would like to ensure consistency of values. Thank you very much!:)

juxuan27 commented 9 months ago

Hi, @VicZlq . It is provided here. Thank you for your focus.

VicZlq commented 9 months ago

Thank you very much for your reply! I'm having some problems with the review. I loaded the humansd-v1.ckpt weights and got a bug when running pose2img_metrics.py: File "/storage/zhaoliuqing/code/HumanSD/ldm/util.py", line 83, in instantiate_from_config if not "target" in config. TypeError: argument of type 'NoneType' is not iterable

I've debugged and it seems that the supplied file does not have a “.model” target in config, have you encountered this problem?

VicZlq commented 9 months ago

Thank you very much for your reply! I'm having some problems with the review. I loaded the humansd-v1.ckpt weights and got a bug when running pose2img_metrics.py: File "/storage/zhaoliuqing/code/HumanSD/ldm/util.py", line 83, in instantiate_from_config if not "target" in config. TypeError: argument of type 'NoneType' is not iterable

I've debugged and it seems that the supplied file does not have a “.model” target in config, have you encountered this problem?

I checked the metrics.yaml code and it seems to be missing model and data settings in there. I copied the model configuration from inference and the problem seems to be solved :)

Do you have the metrics.yaml configuration file that contains the model and data information for inference at that time?

juxuan27 commented 7 months ago

Sorry for the late reply. Copying the model configuration from inference is the right way to solve the problem. We will update the yaml file in the revised version. Thank you for pointing out the problem.