Average agreement calculation

tyiannak / multimodal_movie_analysis

A Python Library for Multimodal Analysis of Movies and Content-based Movie Recommendation

25 stars 8 forks source link

Average agreement calculation #49

Closed sofiaele closed 3 years ago

sofiaele commented 3 years ago

https://github.com/tyiannak/multimodal_movie_analysis/blob/d0c2579efddc3fb574db6df94456beee730fb8b6/annotation/aggregate_annotations.py#L177

Instead of ann_gr_2['Confidence'], print ann_gr['Confidence'], in order for the average agreement to be computed on all samples with 'Number_annotations' >= annotators. Not only on the samples that have 2 annotations.

tyiannak commented 3 years ago

Thanx @sofiaele this has been changed in lastest commit