Add aggregate statistics about review assignments

[NateWr]

Describe the problem you would like to solve One of the Plan S requirements is to provide "basic statistics" that are "published annually" about the number of reviews requested and received.

It's not yet clear exactly what Plan S expects, but some statistics will need to be provided.

Describe the solution you'd like The following suggestion from the forum provided an outline of overall aggregate stats:

In 2020, 451 articles were submitted, 305 were rejected, 107 were accepted and 115 were published. In total, 678 reviews were requested and 499 were received. For the 115 articles published in 2020, the average time since submission was 201 days.

Who is asking for this feature? See forum.

Additional information It may be possible to fulfil the Plan S terms by using the existing Reviews Report tool. If so, it may be enough for us to identify and document how to do it that way.

[willinsky]

PEER REVIEW STATS: Here is one version of what a journal might report on peer-review that would be compliant with Plan S requirements.

We might consider having a section under About called Journal Statistics that would include a free text section along with a number of optional plugin modules that can be activated from the dashboard for Journal Statistics, including (a) Peer Review; (b) Leading Articles; etc., allowing for other custom developments to be added (e.g., Global Readership)

[NateWr]

Thanks @willinsky. Where's that example from?

[willinsky]

I've made this up, Nate, as I find it helpful in thinking about what should be included and how things should be identified and laid out for something like this to mock up a version, and revise it until it makes sense (an which I inevitably want to further modify after living with it for a while).

[kshuttle]

This question is related to one of the statistics requirements of Plan S but is separate from the review assignment stats, so please let me know if this should be posted elsewhere. I am working on some documentation for users regarding Plan S requirements and noted "the average time between submission and publication" is one of the required stats. I've investigating the possible steps for retrieving this statistic and found that the article report does not currently include "Date published," making it impossible (as far as I can see) to calculate the time between submission and publication. The closest alternative date would be "Last modified," but this reflects the most recent version of an article and not the original publication date. As far as I can see (with thanks to @bozana for helping with this), the other stats required by Plan S could be drawn out either through the Editorial Activity report, or by combining stats in the article and review reports. For example, it's possible to filter for "Published" articles in the article report and combine that with the number of items in the review report's "Date notified" column (for "reviews requested") and the number in "Date Completed" column (for "reviews received"). If "Date published" was included in the article report it would be possible to filter the data to see only published articles, and then use a simple formula in excel to calculate Date Published minus Date Submitted to see number of days from submission to publication. The number of days could then be averaged to get the stat required by Plan S.

[NateWr]

Yes, can you file a new feature request issue for this? In the additional comments, can you also comment on behalf of PS about whether the Plan S requirements are important enough to clients that this feature needs to be be back ported to 3.3 LTS or if 3.4 or later is sufficient.

On Fri, 27 May 2022, 01:39 kshuttle, @.***> wrote:

This question is related to one of the statistics requirements of Plan S but is separate from the review assignment stats, so please let me know if this should be posted elsewhere. I am working on some documentation for users regarding Plan S requirements and noted "the average time between submission and publication" is one of the required stats. I've investigating the possible steps for retrieving this statistic and found that the article report does not currently include "Date published," making it impossible (as far as I can see) to calculate the time between submission and publication. The closest alternative date would be "Last modified," but this reflects the most recent version of an article and not the original publication date. As far as I can see (with thanks to @bozana https://github.com/bozana for helping with this), the other stats required by Plan S could be drawn out either through the Editorial Activity report, or by combining stats in the article and review reports. For example, it's possible to filter for "Published" articles in the article report and combine that with the number of items in the review report's "Date notified" column (for "reviews requested") and the number in "Date Completed" column (for "reviews received"). If "Date published" was included in the article report it would be possible to filter the data to see only published articles, and then use a simple formula in excel to calculate Date Published minus Date Submitted to see number of days from submission to publication. The number of days could then be averaged to get the stat required by Plan S.

— Reply to this email directly, view it on GitHub https://github.com/pkp/pkp-lib/issues/6130#issuecomment-1139175494, or unsubscribe https://github.com/notifications/unsubscribe-auth/AARTERMCAOUEX76YTSVLQR3VMAKUXANCNFSM4PLMHHCQ . You are receiving this because you authored the thread.Message ID: @.***>

[bozana]

I've just seen this issue: https://github.com/pkp/pkp-lib/issues/7691. So, no need to create a new one?

[NateWr]

Yes, @kshuttle you may want to add information to #7691 regarding PS's priorities for 3.3 vs 3.4.