usnistgov / ACVP-Server

A repository tracking releases of NIST's ACVP server. See www.github.com/usnistgov/ACVP for the protocol.
39 stars 14 forks source link

Prod test session stuck waiting 20+ hrs #261

Closed abkarcher closed 1 year ago

abkarcher commented 1 year ago

environment Prod

testSessionId 20422

Created yesterday morning (ET); still waiting on vector sets. We are fine with waits, just wanted to open this in case its a technical glitch and not just an unusually large backlog.

Thanks, Andrew

jbrock24 commented 1 year ago

Hi @abkarcher. Currently the Task Queue is just bogged down and has been running requests for probably 24 hours straight. Just a FYI, you can use the Health Status Endpoint to check! Thanks!

jbrock24 commented 1 year ago

Also, just another FYI, you are currently pretty far down on the list for your first VS. I'm not sure the timeframe because each VS can heavily vary by algorithm, but there are 245 vector sets before yours.

abkarcher commented 1 year ago

Thanks for the update!

celic commented 1 year ago

Just a heads up, our internal Task Queue Processor (that processes vector set generation) suddenly and quietly died yesterday. Thanks for the ping on this, we were able to start it back up to continue generating.