Q: download the whole semantic scholar dataset?

allenai / s2-folks

Public space for the user community of Semantic Scholar APIs to share scripts, report issues, and make suggestions.

Other

144 stars 25 forks source link

Q: download the whole semantic scholar dataset? #178

Closed realliyifei closed 5 months ago

realliyifei commented 5 months ago

Is there a quick way to download the latest version of the whole semantic scholar dataset, including the full texts as many as possible, to the local?

cfiorelli commented 5 months ago

You will use the datasets API.

developer documentation can be found here: https://api.semanticscholar.org/api-docs/
please see python examples containing the word "Datasets" here: https://github.com/allenai/s2-folks/tree/main/examples/Webinar%20Code%20Examples
some content for datasets is also available on our tutorial page here: https://www.semanticscholar.org/product/api/tutorial#datasets