search

current12 / Stat-222-Project

3 stars 1 forks source link

Integrate Annotation Project Question Category Classifications #60

Closed ijyliu closed 5 months ago

ijyliu commented 6 months ago

Consider integrating labels/data from annotation project as features.

ijyliu commented 5 months ago

@current12 @seanzhou1207 @OwenLin2001 do you guys have writeup on this to share so we can assess if it's useful? thanks

OwenLin2001 commented 5 months ago

guidelines (1).pdf We have a guideline from AP. Don't think it will be useful given the complexity of "cognitive level" of a question. The inter-annotator agreement is around 0.5 which is not as confident as we hope. This is also on the individual question level so I think we can just dismiss this issue.

ijyliu commented 5 months ago

possible but dont have time