hltcoe / vaporengine

VaporEngine
3 stars 1 forks source link

Overlap visualisation #8

Open jerome-white opened 8 years ago

jerome-white commented 8 years ago

When doing the work for our NAACL paper we found that viewing terms as they overlapped was beneficial. Specifically, being able to see all terms that comprise a spoken region in a way that gives a sense of where the term exists with respect to others (making up that same region) and how deeply nested that term is within the region.

Being able to see something similar in this context could help in transcription, as well as in our own sense of understanding what comes out of the ZR tool.

jerome-white commented 8 years ago

Is this something that the document-level playback achieves? (The top-most playback window in the document view? In this context, regions that have corresponding terms are blue -- what happens if more than one term represents that region?

charman commented 8 years ago

The document-level playback provides very limited support for visualizing overlaps. When the audio playback reaches a point in the file where there is a term, (1) the location indicator in the playback window will be in a blue region and (2) the term shown in the wordcloud will be visually highlighted with a yellow background.

If there are multiple overlapping terms at a particular point in the audio file, then multiple terms will be visually highlighted (with yellow backgrounds) simultaneously.

The system doesn't currently allow you to: (1) use the mouse select a region of audio and visually highlight all of the terms that occur in a region of audio (2) click on a term and visually highlight all of the terms that overlap with that term

CC @rashmisankepally @oard