microsoft / azure-container-apps

Roadmap and issues for Azure Container Apps
MIT License
372 stars 29 forks source link

Container App Failed Java Runtime Error #1277

Closed mquile1209 closed 1 month ago

mquile1209 commented 2 months ago

Please provide us with the following information:

This issue is a: (mark with an x)

Issue description

We started seeing this issue on our container app, we made no changes and have tried redeploying our container several times. We also tried creating a container in our other environments and it worked, we then tried pushing a different container with Java and it worked not problem.

Event Loaded Apache Tomcat Native library [2.0.8] using APR version [1.7.2]. 2024-08-30T01:37:47.993319460Z # 2024-08-30T01:37:47.993443531Z # A fatal error has been detected by the Java Runtime Environment: 2024-08-30T01:37:47.993548196Z # 2024-08-30T01:37:47.993823918Z # SIGSEGV (0xb) at pc=0x00007ebf513e7234, pid=8, tid=12 2024-08-30T01:37:47.993836190Z # 2024-08-30T01:37:47.993843364Z # JRE version: OpenJDK Runtime Environment Temurin-21.0.4+7 (21.0.4+7) (build 21.0.4+7-LTS) 2024-08-30T01:37:47.993865245Z # Java VM: OpenJDK 64-Bit Server VM Temurin-21.0.4+7 (21.0.4+7-LTS, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64) 2024-08-30T01:37:47.993871727Z # Problematic frame: 2024-08-30T01:37:47.994451912Z # C [libcrypto.so.3+0x1fd234] EVP_MD_get0_provider+0x4 2024-08-30T01:37:47.994466589Z # 2024-08-30T01:37:47.994475195Z # Core dump will be written. Default location: Core dumps may be processed with "/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h" (or dumping to /usr/local/tomcat/core.8) 2024-08-30T01:37:47.994498699Z # 2024-08-30T01:37:47.994880332Z # An error report file with more information is saved as: 2024-08-30T01:37:47.994893206Z # /usr/local/tomcat/hs_err_pid8.log 2024-08-30T01:37:48.039778874Z [4.276s][warning][os] Loading hsdis library failed 2024-08-30T01:37:48.253914215Z # 2024-08-30T01:37:48.253943160Z # If you would like to submit a bug report, please visit: 2024-08-30T01:37:48.253951255Z # https://github.com/adoptium/adoptium-support/issues 2024-08-30T01:37:48.253957636Z # The crash happened outside the Java Virtual Machine in native code. 2024-08-30T01:37:48.253963527Z # See problematic frame for where to report the bug. 2024-08-30T01:37:48.253968827Z # 2024-08-30T01:37:48.636958693Z Aborted (core dumped)

Steps to reproduce

Start container Redeploy container

Additional context

Issue occurs in the portal

simonjj commented 2 months ago

@mquile1209 Thanks for reaching out, not sure if someone has addressed this issue with you yet. This is one of the few times I've seen what appears to be a complete JVM crash. This might be a due to a node image update we pushed. This has caused some customers issues when they used Ubuntu 24.04. Is this what you are running? We're now rolling back this change and should be complete by tomorrow PT EOD.

mquile1209 commented 2 months ago

Just a quick update.

I traced the issue to this Tomcat library that uses the OS for OpenSSL was affected by your change.

Event Loaded Apache Tomcat Native library [2.0.8] using APR version [1.7.2].

mquile1209 commented 2 months ago

@mquile1209 Thanks for reaching out, not sure if someone has addressed this issue with you yet. This is one of the few times I've seen what appears to be a complete JVM crash. This might be a due to a node image update we pushed. This has caused some customers issues when they used Ubuntu 24.04. Is this what you are running? We're now rolling back this change and should be complete by tomorrow PT EOD.

Yes we pulled 24.04

cat /etc/os-release

PRETTY_NAME="Ubuntu 24.04.1 LTS" NAME="Ubuntu" VERSION_ID="24.04" VERSION="24.04.1 LTS (Noble Numbat)" VERSION_CODENAME=noble ID=ubuntu ID_LIKE=debian HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" UBUNTU_CODENAME=noble LOGO=ubuntu-logo

simonjj commented 1 month ago

This should be fixed now. Can you please confirm.

mquile1209 commented 1 month ago

We removed the package as we didn't need it so as for us it's resolved.