Gestures: gesture locations

[gregorydimitriadis]

Related back to main gesture enhancements https://github.com/DCS-LCSR/SignStream3/issues/648

Gesture locations are a new feature, and would refer to a new sub-menu of the Gesture Info dialog very similar to the existing location sub-menu from the Gloss Info dialog.

Gesture locations could be updated according to new specifications. Locations are stored in the coding scheme file in a hierarchical manner, with locations and regions defining the specific relationship.

(factoring in comment from Carol below) Different from the gloss location would be the addition of a checkbox for "Ipsilateral vs. Contralateral" to add that property to a location object.

[cneidle]

The hope is that we can use essentially the same partitioning of locations (with perhaps a couple of slight modifications). We might want to use different labels for those same locations.

We would want to add the option of checkboxes for Ipsilateral and Contralateral.

But the biggest difference would be that they would want a separate location field for the dominant and non-dominant hands. So this would involve duplicating whatever location module we come up with.

[gregorydimitriadis]

@cneidle I had forgotten about the requested dom/ndom distinction here. Some questions on that. Would this involve an explicit annotation of dominant location and non-dominant location, as separate things/menus? Would they be done at the same time, or separately? Would/should it be possible to annotate a ndom location in isolation (i.e. without annotating the dom aspect)?

[cneidle]

We can discuss. I haven't given this a lot of thought, but this is the current interface:

Perhaps something like this, for 2-handed signs (where checkbox information would not get copied); otherwise solely the Dominant or Non-dominant (as appropriate) Location Selector if the sign is 1-handed.

[cneidle]

To answer your final question:

Would/should it be possible to annotate a ndom location in isolation (i.e. without annotating the dom aspect)?

Yes - it should be possible to enter whatever the user wants to enter (or not) from the above options...

[cneidle]

So this is how it would be represented in the Utterance window:

[cneidle]

Perhaps adding a suffix if Ipsilateral or Contralateral is checked?

E.g. "eye-I" or "eye-C" ??

[cneidle]

The Sign Bank buttons should probably not be included on the Location tab -- for both signs and gestures -- as we don't currently include Location information in the Sign Bank... And for the main Gesture window, Sign Bank buttons should be grayed out for now, since we do not currently store gestures.

[gregorydimitriadis]

@cneidle from your comment here: https://github.com/DCS-LCSR/SignStream3/issues/658#issuecomment-1437615178

Is it desired to annotate both dom/ndom locations in the same panel, or to instead go into the dom gesture to annotate dom location and the ndom gesture to annotate ndom location? I'm wondering about screen real estate mostly, but also how it would look.

[cneidle]

Same panel. Important for ability to copy between... as Dom and non-dom locations are frequently the same (with possible differences in the checkboxes).

See above; pls iignore material above rectangles, which will be different for gestures.

can be made a bit smaller than what is shown here, and space can be reduced between items.

[cneidle]

Also possible to display e.g. 75% of the height at a time, with scroll enabled - if necessary.

[douglas-motto-at-rutgers]

Clarification for...

The hope is that we can use essentially the same partitioning of locations (with perhaps a couple of slight modifications). We might want to use different labels for those same locations.

Will regions and locations (images and labels) be ...

a) identical for glosses and gestures.

b) different for glosses and gestures.

if a) will all existing regions and locations remain.

[cneidle]

The only change needed is the addition of one region: back of fingertips: turquoise region illustrated below.

This new location interface, as sketched above and with this one addition, can be used across the board: identical for glosses and gestures.

Thank you.