search

NREL / developer.nrel.gov

An issue tracker for NREL's APIs available at https://developer.nrel.gov
45 stars 40 forks source link

HTTP Error 429: Too Many Requests for ~3000 geographic points #170

Closed madalsa closed 3 years ago

madalsa commented 4 years ago

I'm trying to scrape TMY 2018 temperature for almost ~3000 points in continental United States (think county centers) and getting too many requests error. I'm looping over the specific lat/lon and as given in the documentation . I'm not sure if I should retry (didn't get a retry-after header along) or I have been restricted, but appreciate if there's a more elegant way to approach this.

Thanks!

PjEdwards commented 4 years ago

I think these docs may be more appropriate for your use case. 3000 points should be do-able with a few well constructed multi-point requests.

madalsa commented 4 years ago

I think these docs may be more appropriate for your use case. 3000 points should be do-able with a few well constructed multi-point requests.

I can open a new issue for this but a quick follow-up - air_temperature from NSRDB for a particular year, say 2018, is TMY temperature or MERRA 2 values? For TMY3 values, is it necessary to go through SAM? Thank you for your quick response - appreciate it!

PjEdwards commented 4 years ago

Let me ask the team about that and get back to you.

madalsa commented 4 years ago

Let me ask the team about that and get back to you.

Thank you for that!

kurt-rhee commented 3 years ago

Hey @PjEdwards are there any docs on how to download multiple years at the same time? All of the examples I have found in the documentation show how to download one year.

PjEdwards commented 3 years ago

Yeah, all of the endpoint-specific docs have details on all available input parameters. The names param accepts a comma delimited list of years https://developer.nrel.gov/docs/solar/nsrdb/psm3-download/#request-parameters

Regarding your question above about the model details, I dropped the ball on that. I think your best bet for science questions is to post at https://nsrdb.nrel.gov/contact-us.html. That will go to a better audience for that type of intel.

kurt-rhee commented 3 years ago

Awesome thank you! Madalsa is someone else, but I am sure they appreciate the link.

PjEdwards commented 3 years ago

Doh! Didn't pay close attention. Let me know if I can do anything else for you. P