AI4Bharat / OpenHands

πŸ‘OpenHands : Making Sign Language Recognition Accessible. | **NOTE:** No longer actively maintained. If you are interested to own this and take it forward, please raise an issue
https://openhands.readthedocs.io
Apache License 2.0
99 stars 15 forks source link

Question about GSL dataset #26

Closed snorlaxse closed 2 years ago

snorlaxse commented 2 years ago

I have no idea how to get the Isolated gloss sign language recognition (GSL isol.) data (xxx_signerx_repx_glosses), while I only find the continuous sign language recognition data (xxx_signerx_repx_sentences) from https://zenodo.org/record/3941811.

Thank you very much for any information about this.

GokulNC commented 2 years ago

Please check the 0.7GB link here for GSL: https://openhands.ai4bharat.org/en/latest/instructions/datasets.html

Was that not working? Or is there some confusion?

snorlaxse commented 2 years ago

I wanna train the rgb modality using cnn, so l need the raw isolated gsl data. Since the info https://openhands.ai4bharat.org/en/latest/instructions/datasets.html are from the raw rgb data by pose estimator, l guess you know how to get the isolated data. Thanks for your reply.

GokulNC commented 2 years ago

You need to download all the zips domain-wise, like health1.zip, health2.zip, etc. from that Zenodo link

snorlaxse commented 2 years ago

I have downloaded all the zips domain-wise, but they are all continuous sign language recognition data (xx_signerx_repx_sentences) not the Isolated gloss sign language recognition data needed (xx_signerx_repx_glosses). I have how to get the GSL isol data image

.
β”œβ”€β”€ health1
β”‚Β Β  β”œβ”€β”€ health1_signer1_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer1_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer1_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer1_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer1_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer2_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer2_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer2_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer2_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer2_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer3_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer3_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer3_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer3_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer3_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer4_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer4_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer4_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer4_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer4_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer5_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer5_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer5_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer5_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer5_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer6_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer6_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer6_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer6_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer6_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer7_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer7_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer7_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health1_signer7_rep4_sentences
β”‚Β Β  └── health1_signer7_rep5_sentences
β”œβ”€β”€ health1.zip
β”œβ”€β”€ health1_Depth.zip
β”œβ”€β”€ health2
β”‚Β Β  β”œβ”€β”€ health2_signer1_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer1_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer1_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer1_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer1_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer2_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer2_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer2_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer2_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer2_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer3_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer3_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer3_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer3_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer3_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer4_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer4_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer4_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer4_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer4_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer5_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer5_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer5_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer5_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer5_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer6_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer6_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer6_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer6_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer6_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer7_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer7_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer7_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health2_signer7_rep4_sentences
β”‚Β Β  └── health2_signer7_rep5_sentences
β”œβ”€β”€ health2.zip
β”œβ”€β”€ health3
β”‚Β Β  β”œβ”€β”€ health3_signer1_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer1_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer1_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer1_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer1_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer2_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer2_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer2_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer2_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer2_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer3_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer3_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer3_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer3_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer3_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer4_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer4_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer4_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer4_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer4_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer5_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer5_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer5_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer5_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer5_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer6_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer6_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer6_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer6_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer6_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer7_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer7_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer7_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health3_signer7_rep4_sentences
β”‚Β Β  └── health3_signer7_rep5_sentences
β”œβ”€β”€ health3.zip
β”œβ”€β”€ health4
β”‚Β Β  β”œβ”€β”€ health4_signer1_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer1_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer1_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer1_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer1_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer2_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer2_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer2_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer2_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer2_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer3_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer3_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer3_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer3_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer3_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer4_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer4_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer4_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer4_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer4_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer5_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer5_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer5_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer5_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer5_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer6_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer6_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer6_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer6_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer6_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer7_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer7_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer7_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health4_signer7_rep4_sentences
β”‚Β Β  └── health4_signer7_rep5_sentences
β”œβ”€β”€ health4.zip
β”œβ”€β”€ health5
β”‚Β Β  β”œβ”€β”€ health5_signer1_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer1_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer1_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer1_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer1_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer2_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer2_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer2_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer2_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer2_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer3_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer3_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer3_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer3_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer3_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer4_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer4_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer4_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer4_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer4_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer5_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer5_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer5_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer5_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer5_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer6_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer6_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer6_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer6_rep4_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer6_rep5_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer7_rep1_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer7_rep2_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer7_rep3_sentences
β”‚Β Β  β”œβ”€β”€ health5_signer7_rep4_sentences
β”‚Β Β  └── health5_signer7_rep5_sentences
β”œβ”€β”€ health5.zip
β”œβ”€β”€ kep1.zip
β”œβ”€β”€ kep2.zip
β”œβ”€β”€ kep3.zip
β”œβ”€β”€ kep4.zip
β”œβ”€β”€ kep5.zip
β”œβ”€β”€ police1.zip
β”œβ”€β”€ police2.zip
β”œβ”€β”€ police3.zip
β”œβ”€β”€ police4.zip
β”œβ”€β”€ police5.zip
└── supplementary.zip
GokulNC commented 2 years ago

Ok, I was wrong. The Zenodo link does not have the ISLR dataset.

Please try from here: https://drive.google.com/drive/folders/18ruYi9MULMm1KQtUgdIhN0m-XilRhncg

Got that link from here: https://vcl.iti.gr/dataset/gsl/

snorlaxse commented 2 years ago

Thanks a lot. I found these data needed.