Elan experiment type

[rrrokhtar]

Description

Elan experiment: is a new category of experiments (extension to video experiment) that is needed to be added to rapid annotator that allows multiple and infinite count of annotations for each level. New analogies (for elan experiment):

• Level: Tier
• Label: (Annotation) Text

The structure of each annotation entry will be as the following (description of database changes): Note: Database schema updated image is added in docs folder ElanAnnotation:

• id - Int (auto increment)
• experimentId - the experiment is being in the process
• fileId - the file is being annotated
• data - json ; that is the point to be explained

Review of what is the replacement: each selected label was recorded as a single record in AnnotationInfo table. For elan it is instead of keeping a single record for each entry (as they are infinite; not limited to the count of labels inside each level) it was better to use a json type So far, data is a json type contains the following:

{
"levelId01": [{"startTime": 0.01, "endTime": 0.036, "text": "Anythingcan be here"}]
}

It is an object contains (levels/tiers ids of the experiment as keys and for each tierId it contains an array which is the content of annotations) Sample view explained that image is represneted as the following:

{
  "34": [
    {
      "text": "label 1",
      "endTime": 6.5,
      "startTime": 0
    },
    {
      "text": "label 3",
      "endTime": 19.25,
      "startTime": 10.0625
    }
  ],
  "35": [
    {
      "text": "dsa",
      "endTime": 15,
      "startTime": 2.4375
    }
  ]

---

Results is exported in 2 ways

1. All results of the experiment at once in a tabular format contains the following columns (['File Name', 'Annotator', 'Tier Name', 'Annotation Text', 'Start Time (sec)', 'End Time (sec)']) as (csv, xlsx)
2. Export a .eaf (elan file format) of a specific user's annotation for a specific file

User interface changes:

• When creating a new experiment, you will find a new type

• At view results page you will find a new column that allows you to download a .eaf file for each annotation of the selected user and clicked file

• New experiment interface (elan-similar)

• Key bindings

• Add/Edit annotation form

• Add/Edit annotation form Demo

---

• Timeline

• Timeline Demo

Functions

• Zoom in/out
• Scroll (zoom mode or scroll up/down mode)
• Hide other annotations of a track when on is selected, or show all

• Control video buttons

Complete demo (video) for annotation to export results!

https://user-images.githubusercontent.com/39674365/193145851-a3e37263-7374-4298-8047-6e70850644fa.mp4

In case of facing a problem with watching the video on Github you can find it on Youtube

Things need to be discussed

• Grouping multiple annotators' annotations at once in a single (elan) .eaf file of a specific video file;

[peteruhrig]

This looks very good! I think we should however add a few ways of making this faster. In particular, I'm thinking about being able to use keys to select tiers and annotations. Do you think that is possible?

[rrrokhtar]

@peteruhrig
Yes, it is possible! Would you recommend it to add a new field for each tier as a key for it! or simply using the index number of each level, i.e., clicking on "1" leads to selection of the first level and etc. (I think it is better).

[peteruhrig]

I personally think that index number is fine. The question is whether the selection of tier should also be hotkey-able. If so, shall we take the letters of the alphabet, i.e. first tier is "a", second is "b"?

[rrrokhtar]

That's fine, but it may lead to a conflict in case of another label having the same key! so I guess the numbers only for the tiers and letters for the labels may ensure non-conflicts!

[rrrokhtar]

Update:

• The annotation tiers became accessible through numbers as shortcut keys (i.e., first tier can be selected be pressing '1' and second through '2' and etc.).

• Exporting results of grouped annotators of an elan file has been added also.

[peteruhrig]

Tiny change request: Can you put the numbers in front of the Tiers? And another question: Also, can we have selectable annotations? Or do we always have to type the annotation text? I have not fully thought this through, maybe an annotation without text would be a better option for this. What is your take?

[rrrokhtar]

@peteruhrig

Yes sure, they are also indexed at the key-bindings dialog

And updated them to attach the shortcut key beside each tier on the timeline

---

The labels are selectable annotations and have their own shortcut-keys as used in the standard experiment

[peteruhrig]

That's good, but would require the user to remember these, and often the experimenter and the annotator are not the same person, so we need to have it visible in the annotation dialogue.

[rrrokhtar]

The dialog which contains the shortcut-keys is on the annotation page (so it is viewable from the annotator) Do you mean that or something else? The thing would be kept in mind the label's shortcut keys I think key-bindings button

[peteruhrig]

Ah, I did not see a key bindings button. But I'm not convinced it will be great to have the key bindings displayed as an overlay, when we can just add them to the tiers and labels (e.g. in square brackets, or at the beginning of the line followed by a colon).

[peteruhrig]

But you know what, I'll merge it at this state, and then we'll play around and see how it goes.