DCS-LCSR / SignStream3

Sign language linguistics annotation software
1 stars 0 forks source link

Video lookup: small request #710

Closed cneidle closed 1 month ago

cneidle commented 1 month ago

Augustine has fixed the issue with the version number of the Sign Bank, and things are working now !!

These are the different messages I see, depending on how many videos are associated with the file:

1) if there is only one:

(A) Screen Shot 2024-07-13 at 5 26 31 PM

2) if there is more than one:

(B) Screen Shot 2024-07-13 at 5 23 39 PM

I think the messages should be consistent, in specifying that "The video should be front facing and provide a maximally clear view of the signer's hands to ensure the best possible DAI search results."

I think it is weird to have that final sentence.

From within the Morph-Phon window, there is also the "Search Sign Bank" option, as well as the possibility of searching on the Web. But I think it is confusing to say, "You can try searching the DAI... " That seems appropriate, as you have it, when the search fails:

(C) Screen Shot 2024-07-13 at 5 34 09 PM

SO, in that case where things fail, perhaps say: You can try searching the Sign Bank using the "Search Sign Bank" button in the Morph-Phon window, or you can try other ways of searching the DAI from http://dai.cs.rutgers.edu/dai/s/signbank.

cneidle commented 1 month ago

So, to summarize the suggestions above, replace (A) above with:

There is only one video loaded into SignStream. You will get best results when the video is front-facing and includes a clear view of the signer's hands.

replace (B) above with:

Please select a video to use for the DAI search. You will get best results when the video is front-facing and includes a clear view of the signer's hands

replace (C) above with:

DAI search failed: A user selection was not made in the allotted time. Please try again. If you did not find the sign you were looking for among the choices offered, you can try using the "Search Sign Bank" button in the Morph-Phon Window, or you can try other ways of searching the DAI from http://dai.cs.rutgers.edu/dai/s/signbank

cneidle commented 1 month ago

If the user selects "None" from the options provided, this is the message that remains visible:

Screen Shot 2024-07-13 at 5 45 57 PM

with no other error message appearing.

That does not seem right.

It seems that there should be a message appropriate to the user having determined that the search in fact failed.

Something like:

If you did not find the sign you were looking from among the choices offered, you can try using the "Search Sign Bank" button in the Morph-Phon Window, or you can try other ways of searching the DAI from http://dai.cs.rutgers.edu/dai/s/signbank

=========

FWIW, I found this in one of Augustine's old email msgs (6/14/23): { "status": 0, "message": "Choice Made", "data" : { "session": "eb218594-4c29-46ca-aa09-1fa5bdb57a83", "type": "signbank", "schema_version": "1", "data_version": "18", "signText": "chosenSign" // set "sign_text" to "null" without quotes if "None of those" is chosen by user. } }
I

Augustine confirmed that this is the only case where that is returned. So when that happens, the user should receive a message like the one I just suggested. THANKS.

cneidle commented 1 month ago

Another very small change in wording:

Screen Shot 2024-07-13 at 5 25 21 PM

Change the second line to:

"SignStream will now populate the fields in the Morph-Phon Window with the data associated with___ "

Explanation: the term "gloss field" is not right.

thanks!

gregorydimitriadis commented 1 month ago

Regarding the selection of "None" what is currently returned from the DAI at the moment is:

{"status": 0,"message": "Choice Made","data" : {"session": "23F325B74C06A8E7A5E4A8E59095DA5C1721075858239.mp4","type": "signbank","schema_version": "1","data_version": "26","signText": "none"}}

Key part is "signText": "none"

So currently that aspect will not work. That should be changed to "" to work with the current code.

However, sometimes when I test this, clicking None results in the DAI window closing in the browser, and no effect happening in SignStream, as the DAI keeps returning: "status": 1,"message": "Choice Made","data"

Edit 2024-07-16-7:23AM: My mistake, the signText should be -- "signText": null -- for it to work appropriately.

cneidle commented 1 month ago

With the version from July 16th: The video lookup time out is not timing out. The DAI window remains open, and functional (!) -- i.e., you can still select a sign and insert; although the time-out message does appear.

Screen Shot 2024-07-16 at 6 07 01 PM
cneidle commented 1 month ago

The wording changes for selection of video files are good. But these are now the two possibilities, depending on how many videos are available in the SignStream file:

Screen Shot 2024-07-16 at 6 26 12 PM
Screen Shot 2024-07-16 at 6 26 55 PM

Could you please resize the second one, so that it is like the first, and does not extend indefinitely to the right? Thanks


The 'NONE' selection is still not working; we need to coordinate with Augustine.

cneidle commented 1 month ago

Everything is good here now -- EXCEPT for the last two items: the time out issue and the window resizing.