search

dslc-io / club-wapir

https://dslc-io.github.io/club-wapir/
2 stars 2 forks source link

pagination & use of cursor (crossref.org) #49

Closed jimrothstein closed 5 months ago

jimrothstein commented 5 months ago

Slide: httr2-pagination.qmd

In video, you did cover

Regretably, some of us have to do it wrong anyway. So this suggestion, perhaps as footnote, is only to add emphasis: READ the docs!

(1) Good manners = more reliable service

"But we prefer carrots to sticks. As of September 18th 2017 any API queries that use HTTPS and have appropriate contact information will be directed to a special pool of API machines that are reserved for polite users."

(2) TIPS ... https://www.crossref.org/documentation/retrieve-metadata/rest-api/tips-for-using-the-crossref-rest-api/ Don’t use rows and offsets to page through the /works route . They are very expensive and slow. Use cursors instead.

jonthegeek commented 5 months ago

As I mentioned in the meeting, thank you for this! I added user agent info to the Auth chapter because of this, and will definitely talk more about manners & looking for this sort of things in docs in the next iteration of the earlier chapters!