search

DCS-LCSR / SignStream3

Sign language linguistics annotation software
1 stars 0 forks source link

SIGN BANK: sign recognition searching #593

Open gregorydimitriadis opened 2 years ago

gregorydimitriadis commented 2 years ago

Sign recognition refers to a person signing in front of a camera, and it being detected and identified, returning to the user the possible result of what that sign is. This feature would be available on the DAI.

SignStream should then be able to connect to the DAI in some way and get the sign identifier back and insert it into a sign being annotated.

cneidle commented 2 years ago

There are many ways to search through the DAI from the main DAI page -- which will soon include the ability to search based on use of the Sign Recognition module (with input from a Webcam or a sign clip uploaded by the user). This includes the ability to search by related English words, and/or by other properties of the sign. My idea (which I have not yet discussed with Augustine) would be to have a button on the main DAI page which would be, essentially, to copy the identification of a selected sign (e.g., some identifying code behind the scenes) so that it can be pasted into SignStream to find that sign, using that identifying information, taking the user to the sign in question, so that the user could, e.g., copy all information from that Sign into the MorphPhon window.

Screen Shot 2022-09-29 at 12 24 52 PM
cneidle commented 2 years ago

@kwasiopoku for further discussion - not an immediate priority - thanks!

I have discussed the basic idea with Augustine, and he likes it !!

cneidle commented 2 years ago

Other issues related to Sign Bank and connection with DAI

Sort order: #380 , #592 Dealing with display of videos from different data collections: #554 ? : #168

Adding representation of more than 2 handshapes to the Sign Bank: #591

Dealing with potential changes to Sign Bank format: #557 (in Todo 2022-23) Dealing with http vs. https: #555 (in Todo 2022-23)