USACE / cwms-data-api

Corps Water Management System RESTful Data Service
MIT License
13 stars 14 forks source link

Need a better error message when requesting too much data #821

Open ktarbet opened 3 months ago

ktarbet commented 3 months ago

I'm querying hourly data, and once I request 59 or more days ~1400 values, I get a generic error "System Error" without any details.

A message that indicates something like 'your request was too large' would be helpful.

Here is an example:

https://cwms-data.usace.army.mil/cwms-data/timeseries?name=TULA.Flow.Inst.1Hour.0.Ccp-Rev&office=SWT&begin=2024-06-02T15%3A34%3A27.308382&end=2024-07-31T15%3A34%3A27.308382
Enovotny commented 3 months ago

this is only an issue on the DMZ. If you query cwbi-test or other district databases you will not get that error. It is an issue with the DMZ database. once we move to cwms-data to grab from CWBI it shouldn't be an issue.

krowvin commented 2 days ago

@MikeNeilson is it possible to return in the 502/503 response from HAProxy to also state what Karl says "Request was too large"

As a holdover until we go to CWBI.

@DanielTOsborne suggested we could update documentation to be more explicit and add documentation for how to handle proxy errors for end users