FangyunWei / SLRT

253 stars 54 forks source link

Keypoints #2

Open snalyami opened 1 year ago

snalyami commented 1 year ago

Thank you for sharing your code!

Can you please provide the script for extracting the keypoints. I would like to train the model on other datasets.

2000ZRL commented 1 year ago

Please refer to https://github.com/FangyunWei/SLRT/blob/main/NLA-SLR/gen_pose.py. Both TwoStreamNetwork and NLA-SLR use this script to extract keypoints. You can easily extend it to custom datasets by modifying dataloader.

snalyami commented 1 year ago

Thank you for your reply.

I tried installing the requirements for running the pose script but there are issues with installing mmdet and mmpose . I pulled the docker and ran it, but I’m lost. The image doesn’t have the dependences needed. Can you please direct me to how to use the docker.

From: Ronglai Zuo @.> Date: Monday, 27 March 2023 at 6:31 AM To: FangyunWei/SLRT @.> Cc: snalyami @.>, Author @.> Subject: Re: [FangyunWei/SLRT] Keypoints (Issue #2)

Please refer to https://github.com/FangyunWei/SLRT/blob/main/NLA-SLR/gen_pose.py. Both TwoStreamNetwork and NLA-SLR use this script to extract keypoints. You can easily extend it to custom datasets by modifying dataloader.

— Reply to this email directly, view it on GitHubhttps://github.com/FangyunWei/SLRT/issues/2#issuecomment-1484430071, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AKO4VV6ZWVB62MJRW6VP3ODW6ECX5ANCNFSM6AAAAAAWIOGFUI. You are receiving this because you authored the thread.Message ID: @.***>

youloseiwin commented 12 months ago

I encountered some questions while extracting key points from the WLASL dataset,You provide config_file='configs/nla_slr.yaml' python -m torch.distributed.launch --nproc_per_node 8 --master_port 29999 --use_env gen_pose.py --config=${config_file} --split=train,I didn't find the corresponding one 'configs/nla_slr.yaml',What you mean is that I can use “pose_frame64.yaml” or "nla_slr_msasl_100.yaml" to get keypoints?