search

NUWCDIVNPT / stig-manager

An API and client for managing STIG assessments
Other
109 stars 29 forks source link

Benchmark Imports can have lengthy response times in large deployments #1315

Open cd-rite opened 2 months ago

cd-rite commented 2 months ago

When a new benchmark is imported, metrics are recalculated, which can be a lengthy process for large deployments. No feedback is provided until recalculation is complete. This came to our attention because in a deployment w/ nginx that cut off the connection because no response was provided within the default proxy_read_timeout default of 60s.

Consider: Streaming a response showing progress being made to prevent response timeout issue

User also reports getting an "Error: The number of locks exceeds the lock table size." error. Research indicates increasing innodb_buffer_pool_size and/or locking the entire table when processing a large transaction, rather than letting innodb's row locking handle it: https://stackoverflow.com/questions/6901108/the-total-number-of-locks-exceeds-the-lock-table-size

cd-rite commented 1 month ago

user provided screenshot: image

csmig commented 1 month ago

I've opened a new issue for the lock table problem. It is separate from the topic of this issue (long running request).