Memory Leak in 23.2.xx - Githubissues

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

https://www.cockroachlabs.com

Other

29.96k stars 3.79k forks source link

Memory Leak in 23.2.xx #125629

Open sharninder-se opened 3 months ago

sharninder-se commented 3 months ago

Describe the problem

A couple of weeks back we upgraded to 23.2.5 and have since been facing, what looks like a memory leak. The cockroachdb processes are using much more memory than before and eventually hit the Kubernetes limit and gets restarted.

To Reproduce

Upgrade to 23.2.xx and observe rss mem for cluster

Screenshot 2024-06-13 at 2 28 15 PM

Jira issue: CRDB-39537

blathers-crl[bot] commented 3 months ago

Hi @sharninder-se, please add branch-* labels to identify which branch(es) this C-bug affects.

_{:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}

blathers-crl[bot] commented 3 months ago

Hello, I am Blathers. I am here to help you get the issue triaged.

Hoot - a bug! Though bugs are the bane of my existence, rest assured the wretched thing will get the best of care here.

I was unable to automatically find someone to ping.

If we have not gotten back to your issue within a few business days, you can try the following:

Join our community slack channel and ask on #cockroachdb.
Try find someone from here if you know they worked closely on the area and CC them.

_{:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}

yuzefovich commented 3 months ago

Can you share the heap profile?