openreview-data-scrape
An efficient and convenient way to crawl the iclr conference peer review information and pdf on the openreview website, taking ICLR2024 as an example
example website
files structure
- get_openreview_id.py - Used to get the unique ID of each paper.
- get_openreview_pdf.py - Used to obtain PDF files of each paper.
- get_openreview_information.py - Used to obtain relevant information for each paper.
- get_openreview_review.py - Used to obtain review information for each paper.
Method
First, running get_openreview_id.py will save the id_dict.json file locally.
Then use the json file generated above to run the remaining three py files in parallel to obtain the corresponding information locally at the same time.
Result Demo
-
Information result：
-
Review result：
-
Pdf result：
