search

EricGuo5513 / HumanML3D

HumanML3D: A large and diverse 3d human motion-language dataset.
MIT License
798 stars 78 forks source link

Question regarding noise in the dataset 007406 #121

Open RobertBiehl opened 9 months ago

RobertBiehl commented 9 months ago
source_path start_frame end_frame new_name
./pose_data/CMU/86/86_05_poses.npy 434 634 007406.npy

Text:

Caption 3 is mentioning jumping jacks and thus is inconsistent with caption 1 and 2. Looking at the source animation the jumping jacks are indeed there but not in the range of 434 to 634 (@ 20fps).

See https://github.com/una-dinosauria/cmu-mocap/blob/master/data/086/86_05.bvh (can be opened with Autodesk Preview if in doubt). If looking at the raw bvh file the sequence in question is between frame 434 * 6 and 634 * 6 (@ 120fps) If looking at the bvh in Autodesk Preview sequence in question is between frame 434 * 1.5 and 634 * 1.5 (it is displayed at @ 30fps)

@EricGuo5513 Could there have been an issue with the annotation process that the annotators saw incorrect parts of the sequence?

EricGuo5513 commented 9 months ago

Hi there is possibility that the annotations make incorrect descriptions.

On Tue, Jan 30, 2024 at 8:51 AM Robert Biehl @.***> wrote:

source_path start_frame end_frame new_name ./pose_data/CMU/86/86_05_poses.npy 434 634 007406.npy

a person makes a big jump forward, then a big jump to the right, and then hops on one foot.#a/DET person/NOUN make/VERB a/DET big/ADJ jump/NOUN forward/ADV then/ADV a/DET big/ADJ jump/NOUN to/ADP the/DET right/NOUN and/CCONJ then/ADV hop/VERB on/ADP one/NUM foot/NOUN#0.0#0.0 a person jumps forward, turns to the left jumps forward again, then on the spot jumps up and down with its right leg.#a/DET person/NOUN jump/VERB forward/ADV turn/VERB to/ADP the/DET left/NOUN jump/VERB forward/ADV again/ADV then/ADV on/ADP the/DET spot/NOUN jump/VERB up/ADV and/CCONJ down/ADV with/ADP its/DET right/ADJ leg/NOUN#0.0#0.0 the person is doing jumping jacks#the/DET person/NOUN is/AUX do/VERB jump/VERB jack/NOUN#0.0#0.0

The last of the 3 caption is not consistent to the others, as it is mentioning jumping jacks. Looking at the source animation the jumping jacks are indeed there but not in the range of 434 to 634 @.*** https://github.com/20fps).

See https://github.com/una-dinosauria/cmu-mocap/blob/master/data/086/86_05.bvh (can be opened with Autodesk Preview if in doubt). If looking at the raw bvh file the sequence in question is between frame 4346 and 6346 @.** https://github.com/120FPS) If looking at the bvh in Autodesk Preview sequence in question is between frame 4341.5 and 634*1.5 (it is displayed at @30fps https://github.com/30fps)

@EricGuo5513 https://github.com/EricGuo5513 Could there have been an issue with the annotation process that the annotators saw incorrect parts of the sequence?

— Reply to this email directly, view it on GitHub https://github.com/EricGuo5513/HumanML3D/issues/121, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKRYNB4IIU3TNLEBKIISJ53YREQJJAVCNFSM6AAAAABCRS5C7KVHI2DSMVQWIX3LMV43ASLTON2WKOZSGEYDQMZSGI2DENY . You are receiving this because you were mentioned.Message ID: @.***>

RobertBiehl commented 9 months ago

Hi Eric, Did you show the annotators the whole original sequence or just the part between start and end? I wonder how that particular annotation has been created if the jumping jacks were before start-frame.

RobertBiehl commented 9 months ago

@EricGuo5513 fixed the numbers above, there was a formatting issue. xD Would be great if you could check this out.