search

pybliometrics-dev / pybliometrics

Python-based API-Wrapper to access Scopus
https://pybliometrics.readthedocs.io/en/stable/
Other
410 stars 128 forks source link

[FeatureRequest] Replace SearchMaxEntries constant with replaceable value #212

Closed mark-todd closed 2 years ago

mark-todd commented 2 years ago

Background

It's useful to be able to perform large searches on Scopus sometimes, even if that means losing a large amount of request allowance. However, there needs to be a limit, so that the request allowance is not consumed in one search.

Problem

The current version of Pybliometrics has a fixed value for SEARCH_MAX_ENTRIES at 5000, which cannot be altered when Pybliometrics is imported as a package. https://github.com/pybliometrics-dev/pybliometrics/blob/master/pybliometrics/scopus/utils/constants.py#L55

Solution

Perhaps 5000 could be the default value of SEARCH_MAX_ENTRIES, but this could be overridable by specifying a different value in the config file.

mark-todd commented 2 years ago

Apologies, I've just found a section of the Scopus documentation that discusses this, and I see now this is a fixed part of the Scopus API: https://dev.elsevier.com/api_key_settings.html I also notice you already support the cursor navigation feature, so I presume this 5000 limit is irrelevant for Scopus Search.

Michael-E-Rose commented 2 years ago

Yes exactly, Scopus imposes the maximum size of the search results. It still applies to the other Search APIs unfortunately.