CI: Wind hindcast API Calls

MHKiT-Software / MHKiT-Python

MHKiT-Python provides the marine renewable energy (MRE) community tools for data processing, visualization, quality control, resource assessment, and device performance.

https://mhkit-software.github.io/MHKiT/

BSD 3-Clause "New" or "Revised" License

47 stars 45 forks source link

CI: Wind hindcast API Calls #315

Open ssolson opened 2 months ago

ssolson commented 2 months ago

The wind hindcast data currently takes greater than 3.5 hours to collect the needed data.

Can we get this down to 1 hr to be on par with the wave data?

akeeste commented 1 month ago

The metocean example pulls wind toolkit data and is pretty fast. We should look at replacing our test data with what's used in that example

akeeste commented 4 days ago

I'm attempting to look into this today. I started testing locally but it seems like I'm already being rate limited.

My initial testing indicates that multiparameter requests are running as expected (the metocean example only does this), but for some reason multiyear and multilocation requests are very slow. I'll keep investigating this today and next week as the NREL server allows

akeeste commented 45 minutes ago

Hopefully #315 shows some performance improvements. But in the typical manner of pulling this data, it was successful once locally and then downloads started hanging for long times.