The manuscript describes "ground truth" of article quality and editor
expertise, but it's unclear what specific construct was used that is
independent of the editing behavior. Editor experise is measured as labor
hours, but this seems instrinsically correlated with the number of
articles edited. Article quality was measured with a PCA combining markup
complexity, headings, article length, citations, and links. The
implementation of the adapted random walker method returns correlations
in excess of .6 with other measures of article and editor quality.
There's also a question of how much gain does this walker method produce
over more naive methods that don't account for the network structure and
influence to serve as a baseline.
The manuscript describes "ground truth" of article quality and editor expertise, but it's unclear what specific construct was used that is independent of the editing behavior. Editor experise is measured as labor hours, but this seems instrinsically correlated with the number of articles edited. Article quality was measured with a PCA combining markup complexity, headings, article length, citations, and links. The implementation of the adapted random walker method returns correlations in excess of .6 with other measures of article and editor quality. There's also a question of how much gain does this walker method produce over more naive methods that don't account for the network structure and influence to serve as a baseline.