search

Geosphere-Austria / dataset-api-docs

This is the documenation source for the dataset API provided by Geosphere Austria
https://dataset.api.hub.geosphere.at/v1/docs
10 stars 1 forks source link

Timeout querying Spartacus for larger areas #12

Closed febsn closed 1 year ago

febsn commented 1 year ago

I always get 504 Gateway Timeout errors ("Kong Error, the upstream server is timing out") when querying larger areas for spartacus-v2-1m-1km data. I'm trying to get precipitation data for Lower Austria, but even if I increase spatial_resolution_m to 10000 or even 100000 the connection times out.

An example query I'm using is https://dataset.api.hub.geosphere.at/v1/grid/historical/spartacus-v2-1m-1km?parameters=RR&start=2021-01-01T00%3A00&end=2021-01-01T00%3A00&bbox=47.40%2C14.41%2C49.02%2C17.08&output_format=geojson&spatial_resolution_m=10000

Am I making a mistake in querying, or is the API not prepared for areas of that size? I couldn't find any constraints in the docs. Please let me know if I can provide further information.

afuchs-geosphereat commented 1 year ago

Your requests looks fine and is well within the request size limit.

Instead it seems the timeout is caused by a bug when creating the geojson output. We will look into it. Thanks for bringing this to our attention.

In the meantime, if this is an option for you, you can use output_format=netcdf, which seems to work fine.

febsn commented 1 year ago

Thank you very much for your response! I'll wait for further updates, please let me know if I can contribute anything.

afuchs-geosphereat commented 1 year ago

Hello @febsn, We have deployed a fix today. The above query should not cause a timeout anymore. Best regards

febsn commented 1 year ago

Thank you very much! I worry it's still not performant enough for a web application, maybe we have to take another approach. I have already written to M. Nutz on that matter.