openreview / openreview-py

Official Python client library for the OpenReview API
https://openreview-py.readthedocs.io/en/latest/
MIT License
138 stars 18 forks source link

Fix/ethics review settings #2172

Closed celestemartinez closed 1 month ago

celestemartinez commented 1 month ago

The following issues are fixed here:

Fixes: #2164 and items (2) and (3) of #2126

melisabok commented 1 month ago

since we are using append in the invitation, we add them even if the paper is public

Does it mean the readers could be [everyone, ARR/Submission1/Ethic_Chairs]?

I think we should avoid this.

celestemartinez commented 1 month ago

since we are using append in the invitation, we add them even if the paper is public

Does it mean the readers could be [everyone, ARR/Submission1/Ethic_Chairs]?

I think we should avoid this.

Yes, I am looking at the test and the readers of some papers end up being eveyone, Submission1/Ethics_Reviewers and Ethics_Chairs. I won't do this with the invitation then and add the readers in the process function instead.

This didn't use to be an issue because I would check if submissions were public. However, ARR has some submissions hidden and some public and we use the same invitation to flag all submissions, so this does not work anymore.

melisabok commented 1 month ago

I don't think we can use an invitation if not all the submissions have the same set the of readers, we would need to use the meta invitation is set the readers accordingly.

celestemartinez commented 1 month ago

Two points:

  1. Right now I am always adding the ethics chairs as readers of reviews. Should this be done only if the PC choose to make submissions visible to ethics chairs? I would need to check this in a couple of places.
  2. The Ethics_Flag invitation now only adds the flagged_for_ethics field and the process function appends/removes readers depending on that value. Not sure if there is a better way to do this since this creates two edits on the submissions.
melisabok commented 1 month ago
  1. Do we have a setting in the review stage to make review visible to ethics chairs?
  2. I think two edits is fine.
melisabok commented 1 month ago

@celestemartinez do you have any update on this?

celestemartinez commented 1 month ago

Sorry about that; this PR should be ready. I made a change so only if the PCs choose to make submissions visible to ethics chairs then ethics chairs are added as readers of comments. Otherwise, they would have to use the submission SAC group like CVPR does.