Memory Requirements

[stobbsm]

Operating system

• Linux (Rocky 9.3)

When running, first with 8GB of memory and then with 32GB of memory, the OS is reporting OOM killing. Looking at the memory usage, the candig specific containers (specifically ingest, federation and query) are using 7+GB of memory each.

The OS is killing uwsgi for ingest over and over.

Is this a bug, or are the memory requirements really that high?

[stobbsm]

Just for reference, I took a screenshot of docker stats.

Tests are failing as well, but I'm going through everything manually according to the documentation to make sure I have it right before I ask for help.

[OrdiNeu]

They shouldn't be -- for reference, here's a look at mine:

CONTAINER ID   NAME                            CPU %     MEM USAGE / LIMIT     MEM %     NET I/O           BLOCK I/O         PIDS
eba06964c91d   candigv2_candig-data-portal_1   0.28%     1.227GiB / 15.41GiB   7.96%     580kB / 3.38MB    401MB / 269MB     31
ed9260b52bcb   candigv2_candig-ingest_1        0.01%     44.73MiB / 15.41GiB   0.28%     509kB / 0B        1.74MB / 8.25MB   8
dcfffc2c8dbe   candigv2_federation_1           0.01%     63.77MiB / 15.41GiB   0.40%     978kB / 462kB     8.15MB / 12.3MB   6
4c52e7430d1a   candigv2_opa-runner_1           0.00%     1.098MiB / 15.41GiB   0.01%     529kB / 1.31kB    9.4MB / 28.7kB    2
ce2a6bb054a9   candigv2_opa_1                  0.41%     8.766MiB / 15.41GiB   0.06%     664kB / 27.5kB    117MB / 209kB     13
6dcac04882b9   candigv2_tyk_1                  0.20%     45.54MiB / 15.41GiB   0.29%     26.6MB / 30MB     732MB / 2.75MB    14
10797e4b77f7   candigv2_tyk-redis_1            2.50%     3.723MiB / 15.41GiB   0.02%     9.92MB / 5.18MB   39.4MB / 176kB    4
3667d4482ffd   candigv2_vault_1                0.96%     44.62MiB / 15.41GiB   0.28%     930kB / 460kB     710MB / 273MB     14
845bb503bdc4   candigv2_vault-runner_1         0.00%     2.066MiB / 15.41GiB   0.01%     530kB / 4.62kB    22.9MB / 16.4kB   3
bcb5e00adcba   candigv2_keycloak_1             1.17%     529.2MiB / 15.41GiB   3.35%     560kB / 1.97MB    799MB / 74.3MB    135
a1f7e0a0df41   candigv2_query_1                0.01%     54.95MiB / 15.41GiB   0.35%     1.13MB / 597kB    162MB / 15.4MB    7
ccf29bbbbd5f   candigv2_katsu_1                0.00%     232.5MiB / 15.41GiB   1.47%     960kB / 398kB     74.3MB / 87MB     6
4453a8b22911   candigv2_htsget_1               0.03%     238.1MiB / 15.41GiB   1.51%     19.5MB / 13.6MB   69.9MB / 47.8MB   7
93975d3c8543   candigv2_metadata-db_1          0.01%     50.3MiB / 15.41GiB    0.32%     12.2MB / 19MB     421MB / 499MB     7
15119a3aabe9   candigv2_minio_1                1.42%     91.91MiB / 15.41GiB   0.58%     577kB / 3.76kB    690MB / 22.7MB    13

Which tests are failing for you?

[stobbsm]

I have those documented in #373

[mshadbolt]

Our stack has moved on quite a bit since this issue was filed, hoping this has been fixed with more recent updates but do re-open if you are continuing to have issues