search

DeveloperLiberationFront / AffectAnalysisToolEvaluation

SEmotion_18 paper on evaluating the reliability of sentiment and politeness analysis tools
3 stars 4 forks source link

Complain against URL processing #10

Closed nasifimtiazohi closed 6 years ago

nasifimtiazohi commented 6 years ago

R2

I wonder if the authors thought about how the tools might work if the text of the URL's was also processed. I mean the raters were provided with these URLs so it could be that they used them. How can we know for certain?

nasifimtiazohi commented 6 years ago

Giving URLs to the coders but not to the tool was a bad decision.

Should've removed the URLs before providing to both coders and tools.

Mentioned this in the threat now.

https://github.com/DeveloperLiberationFront/AffectAnalysisToolEvaluation/commit/12ebce60634ef73ac2ff1b32024009deb72f24bb