apache / gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
https://datastrato.ai/docs/
Apache License 2.0
680 stars 208 forks source link

[Bug report] Doris web e2e failed when only 8GB memory in docker #3392

Open LauraXia123 opened 1 month ago

LauraXia123 commented 1 month ago

Version

main branch

Describe what's wrong

When I setting 8GB memory in the Docker, then doris web e2e failed. When I setting 16GB memory in the Docker, then doris web e2e success.

image

Error message and/or stacktrace

OpenJDK 64-Bit Server VM (25.402-b06) for linux-aarch64 JRE (1.8.0_402-8u402-ga-2ubuntu1~22.04-b06), built on Feb 27 2024 07:25:38 by "buildd" with gcc 11.4.0
Memory: 4k page, physical 8137636k(171532k free), swap 1048572k(1048048k free)
CommandLine flags: -XX:-CriticalJNINatives -XX:InitialHeapSize=130202176 -XX:MaxHeapSize=1073741824 -XX:+PrintGC -XX:+PrintGCTimeStamps -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseParallelGC 
0.217: [GC (Allocation Failure)  32768K->4093K(123904K), 0.0032893 secs]
0.330: [GC (Allocation Failure)  36861K->4303K(156672K), 0.0024209 secs]

How to reproduce

Setting 8 GB memory in the dorcker, and run doris web e2e test

Additional context

No response

LauraXia123 commented 1 month ago

@zhoukangcn Could you help to fix this issue?

zhoukangcn commented 1 month ago

@LauraXia123 I will fix this issue later.

I have a little problem, what's the minum docker memory? We'd best add the limit in Docker environment checker and add to documents.

Do you have any advice? @xunliu

zhoukangcn commented 2 weeks ago

@LauraXia123 I try to fix this issue in #3883

But I cannot reproduce this failure in my local machine with 8G memory in docker.

Can you help to test with image docker.io/zhoukangcn/gravitino-ci-doris:0.1.4

you need to update in file integration-test/build.gradle.kts and catalogs/catalog-jdbc-doris/build.gradle.kts

zhoukangcn commented 2 weeks ago

@LauraXia123 as #3883 has been merged. Please try again.