search

oss-aspen / 8Knot

Dash app in development to serve open source community visualizations using GitHub data from Augur. Hosted app: https://eightknot.osci.io
MIT License
47 stars 59 forks source link

Large org request on OCP 8Knot instance cause OOM #429

Closed JamesKunstle closed 11 months ago

JamesKunstle commented 1 year ago

When searching for 'openshift' or other large orgs, the query workers are eventually killed and Redis decides to die.

eightknot-query-worker-745dc6d76f-kp2pl-eightknot-query-worker.log

redis-7c6878f8dc-qhptw-redis.log

Attached two log files to be gone through. Input was just 'openshift' org w/o anyone else on the cluster.

Resource utilization:

Screenshot 2023-08-29 at 2 03 27 PM Screenshot 2023-08-29 at 2 03 45 PM

I killed all the pods to restart 8Knot which fixed it.

JamesKunstle commented 1 year ago

Causes Celery worker heartbeats to be list (killed? too busy?) and redis to report that unknown child PIDs are runnning.

JamesKunstle commented 11 months ago

Closing as duplicate of #457