is async a possibility?

njahn82 / ropenaire

R client for OpenAIRE

Other

6 stars 2 forks source link

is async a possibility? #3

Open sckott opened 6 years ago

sckott commented 6 years ago

Is asynchronous requests wih the Openaire API acceptable/okay?

I don't know yet if we'll need it for the Openknowledgemaps use case, but just wondering if it's something that Openaire API devs are okay with.

sckott commented 6 years ago

@njahn82 thoughts?

sckott commented 6 years ago

@njahn82 @alessiabardi @joschirr any thoughts on whether you're okay with us doing async requests to the openaire API? Or woul you prefer we do not do that?

A related question: Is there any rate limiting information on the API? I haven't seen any yet

alessiabardi commented 6 years ago

What do you mean "doing async requests"? Do you mean parallel requests? In this case consider that we allow

no more then 37 concurrent request in total (max 30 per single IP)
no more than 15 requests/second (in total, not per IP. If this limit is reached, requests will be delayed).

sckott commented 6 years ago

Sort of in parallel - can be thought of as the same thing. Okay, thanks for the information.

@pkraker seems like we can try async requests where they make sense and below the rate limits above. let me know if i should try that out

pkraker commented 6 years ago

Thanks @sckott! This would certainly be useful in the automated processing component for mass creation of maps that we will develop as part of the project. But since that is further down the line, I would prioritize the other tasks (implementing the rest of the parameters for roa_pubs and roa_datasets, in particular funder) over this task.

sckott commented 6 years ago

Okay, thanks