DCS-LCSR / SignStream3

Sign language linguistics annotation software
2 stars 0 forks source link

Gestures: Palm orientation #654

Closed gregorydimitriadis closed 1 year ago

gregorydimitriadis commented 1 year ago

Related back to main gesture enhancements #648

Closely related to #655 (fingertip orientation)

In the current gesture implementation there is an orientation field (one for dom, one for ndom) which corresponds with the handshape field. This issue would refashion a generic orientation field into a specific orientation field for palm orientation. The linked issue for fingertip orientation would be building a new field entirely.

Involved in this is: getting the updated orientation images as part of specifications, using those in the coding scheme file, updating the images in the application, and updating in the code the relevant usages of these images.

gregorydimitriadis commented 1 year ago

@cneidle comparing this to how gestures has worked in the past:

When annotating a gesture, and selecting handshapes/orientations, what is the intended flow:

A person opens up the palette to select handshapes/orientations. They select a handshape. Are they required to select a corresponding palm orientation to match that handshape? Are they required to select a corresponding fingtertip orientation also? Are the orientations independent, or must co-occur? (as handshapes and (generic) orientations did in previous SignStream releases with gesture capabilities)

cneidle commented 1 year ago

This is what we have now, for co-speech gestures.

Screen Shot 2023-02-20 at 4 34 33 PM

It is possible to choose 'do not include' for the orientations.

But an orientation, if present, has to be paired with a handshape.

So for every handshape, there is either a specified orientation, or none (if 'do not include' is selected).

The difference would be that there would be an extra row. So every handshape would be associated with one or both orientations (for either or both, "do not include" can be selected):

Screen Shot 2023-02-20 at 4 34 40 PM
gregorydimitriadis commented 1 year ago

If a handshape is selected, (assuming no orienation for the gesture) would a user then have to selected 'do not include' for palm and 'do not include' again for fingertip? I think there will be two orientation "palettes" one for palm and one for fingertip.

cneidle commented 1 year ago

Yes on both counts, as shown in the picture above.

douglas-motto-at-rutgers commented 1 year ago

Do orientations have selectable palettes? As shown by the dropdown next to "Orientations:". Similar to "Handshapes:"

If selectable, are all orientations palettes selectable as a palm and fingertip? Or some palettes just for palm or just for fingertip.

cneidle commented 1 year ago

Subsumed by #655.