search

DeveloperLiberationFront / AffectAnalysisToolEvaluation

SEmotion_18 paper on evaluating the reliability of sentiment and politeness analysis tools
3 stars 4 forks source link

Rephrasing confusing statements #8

Closed nasifimtiazohi closed 6 years ago

nasifimtiazohi commented 6 years ago

R2

I didn't quite understand what the following sentence meant: "However, Coder 1’s agreement on politeness is higher than sentiment with both the other coders. One reason behind this can be that the annotation scheme for politeness was more detailed with relevant examples.

Is a coding scheme presented for quantifying sentiment? Why was one presented for politeness only?

How does Table 1 related to the scores of -2 to 2? I was lost on this one.

R1

In section 2.3 author state "We choose GitHub for our research setting as it is the largest code host and the comments are more representative of developers’ discussion in general." It is not clear to me why GitHub is more representative of developers discussions than other platforms where developers discuss such as Jira, StackOverFlow or Reddis for example.

nasifimtiazohi commented 6 years ago

removed more from - the comments are more representative of developers

nasifimtiazohi commented 6 years ago

fixed in https://github.com/DeveloperLiberationFront/AffectAnalysisToolEvaluation/commit/b57a8383777a0f2fbea12fe3c784fcf0749be5c9