Swirrl / ook

Structural search engine
https://search-prototype.gss-data.org.uk/
Eclipse Public License 1.0
6 stars 0 forks source link

Nginx responds with 400 Bad Request on observations beginning with subject 1,763,860. #121

Closed Robsteranium closed 1 year ago

Robsteranium commented 2 years ago

We keep getting a 400 Bad Request response from Nginx on observations beginning with subject 1,763,860.

There might be an unusual URI in there (e.g. with angle brackets?) that's leading to a malformed query.

Ook spills the observation URIs to a temporary file, we could look at the corresponding page of URIs to see if there's anything unusual.

We might also try dumping the offending construct query to disk - e.g. by adding something to the ook.etl/with-retry macro.

Robsteranium commented 2 years ago

I've written a with-logged-retry macro and kicked off the pipeline again. I'll check on Friday.

Robsteranium commented 2 years ago

This appears to be caused by #122

Robsteranium commented 1 year ago

This is resolved by #124 :+1: