hongfz16 / AvatarCLIP

[SIGGRAPH 2022 Journal Track] AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars
https://hongfz16.github.io/projects/AvatarCLIP.html
Other
1.07k stars 93 forks source link

Motion Generation: Generate less than 5 poses thus failing to generate motions. #23

Open liyitang22 opened 7 months ago

liyitang22 commented 7 months ago

The config file is:

general {
    base_exp_dir = ./exp/motion_ablation/motion_optimizer/run
    mode = motion
    text = a rendered 3d male is standing depressingly
}

pose_generator {
    type = VPoserCodebook
}

motion_generator {
    type = MotionInterpolation
}

Then the error

Traceback (most recent call last): File "main.py", line 67, in main(args.conf) File "main.py", line 47, in main motion = motion_generator.get_motion(text, poses=candidate_poses) File "./AvatarCLIP/AvatarAnimate/models/motion_generation.py", line 128, in get_motion end_code = candidate_latent_codes[i] IndexError: index 4 is out of bounds for dimension 0 with size 4"

is displayed.

I think the problem may come from the code in line 327 in AvatarAnimate/models/pose_generation.py

poses = self.suppress_duplicated_poses(poses, threshold=self.filter_threshold)

After "suppress_duplicated_poses", there may be less than k(in this context k=5) poses, thus failing to generate corresponding motions.