Since we upgraded this we've been seeing an intermittent issue with very low information, so we're going to try revert this and evaluate it over the coming days before digging further.
The issue we're experiencing is that POST request to /:index/documents are infrequently returning 500 errors (about 4.5%) and the error details we have is: SystemStackError: stack level too deep and the stack trace indicating it's a call_pipeline method in: PrometheusExporter::Instrumentation::MethodProfiler which was created as a result of metaprogramming in PrometheusExporter::Middleware.
With the lack of stack trace and intermittent nature, we've been at a loss to work out the cause so we're just rolling back the most recent change (this) and going to monitor it to see if it's resolved before further investigation/communication.
Reverts alphagov/search-api#2830
Since we upgraded this we've been seeing an intermittent issue with very low information, so we're going to try revert this and evaluate it over the coming days before digging further.
The issue we're experiencing is that POST request to
/:index/documents
are infrequently returning 500 errors (about 4.5%) and the error details we have is:SystemStackError: stack level too deep
and the stack trace indicating it's acall_pipeline
method in: PrometheusExporter::Instrumentation::MethodProfiler which was created as a result of metaprogramming in PrometheusExporter::Middleware.With the lack of stack trace and intermittent nature, we've been at a loss to work out the cause so we're just rolling back the most recent change (this) and going to monitor it to see if it's resolved before further investigation/communication.