Out of memory when plenty available

[acrespillo]

Describe the bug

I'm running ib-gateway docker image using an AWS t3.xlarge instance (16gb memory). My algorithm always gets disconnected after 2h hours of normal operation after what seems a crash at the ib-gateway container.

At the docker logs can be seen a memory usage issue, but not sure if that comes from any misconfiguration on my end (logs and docker compose config attached).

Expected

A clear and concise description of what you expected to happen.

Docker compose config

`

name: test services: ib-gateway: build: context: /home/ubuntu/ib-gateway-docker/latest dockerfile: Dockerfile tags:

• ghcr.io/gnzsnz/ib-gateway:latest devices:
  • /dev/dri:/dev/dri environment: ALLOW_BLIND_TRADING: "no" AUTO_LOGOFF_TIME: "" AUTO_RESTART_TIME: 11:59 PM BYPASS_WARNING: "" CUSTOM_CONFIG: "NO" EXISTTING_SESSION_DETECTED_ACTION: primary JAVA_HEAP_SIZE: "" READ_ONLY_API: "no" RELOGIN_AFTER_TWOFA_TIMEOUT: "no" SAVE_TWS_SETTINGS: "" SSH_ALIVE_COUNT: "" SSH_ALIVE_INTERVAL: "" SSH_OPTIONS: "" SSH_PASSPHRASE: "" SSH_REMOTE_PORT: "" SSH_RESTART: "" SSH_TUNNEL: "" SSH_USER_TUNNEL: "" SSH_VNC_PORT: "" TIME_ZONE: Europe/Berlin TRADING_MODE: paper TWOFA_EXIT_INTERVAL: "60" TWOFA_TIMEOUT_ACTION: restart TWS_ACCEPT_INCOMING: manual TWS_COLD_RESTART: "" TWS_PASSWORD: xxx TWS_PASSWORD_PAPER: "" TWS_SETTINGS_PATH: "" TWS_USERID: xxx TWS_USERID_PAPER: "" TZ: Europe/Berlin VNC_SERVER_PASSWORD: myVncPassword image: ghcr.io/gnzsnz/ib-gateway:latest networks: default: null ports:
  • mode: ingress host_ip: 127.0.0.1 target: 4003 published: "4001" protocol: tcp
  • mode: ingress host_ip: 127.0.0.1 target: 4004 published: "4002" protocol: tcp
  • mode: ingress host_ip: 127.0.0.1 target: 5900 published: "5900" protocol: tcp restart: always security_opt:
  • seccomp:unconfined shm_size: "1073741824" volumes:
  • type: bind source: /home/ubuntu/ib-gateway-docker/config target: /config bind: create_host_path: true
  • type: volume source: tws_tmp target: /tmp volume: {} networks: default: name: test_default volumes: tws_tmp: name: test_tws_tmp`

Container logs

`

ib-gateway-1 | 2024-08-21 12:02:06:111 IBC: detected dialog entitled: Warning; event=Activated ib-gateway-1 | 2024-08-21 12:02:06:113 IBC: detected dialog entitled: Warning; event=Focused ib-gateway-1 | 2024-08-21 12:02:06:114 IBC: detected dialog entitled: Warning; event=Opened ib-gateway-1 | 2024-08-21 12:02:06:115 IBC: Click button: I understand and accept ib-gateway-1 | 2024-08-21 12:02:06:219 IBC: Setting ReadOnlyApi ib-gateway-1 | 2024-08-21 12:02:06:374 IBC: Read-Only API checkbox is now set to: false ib-gateway-1 | 2024-08-21 12:02:06:374 IBC: Setting Auto restart time ib-gateway-1 | 2024-08-21 12:02:06:420 IBC: Auto restart time set to 11:59 PM ib-gateway-1 | 2024-08-21 12:02:06:468 IBC: detected dialog entitled: Warning; event=Lost focus ib-gateway-1 | 2024-08-21 12:02:06:469 IBC: detected dialog entitled: Warning; event=Deactivated ib-gateway-1 | 2024-08-21 12:02:06:469 IBC: detected dialog entitled: Warning; event=Closed ib-gateway-1 | 2024-08-21 12:02:06:470 IBC: Configuration tasks completed ib-gateway-1 | 2024-08-21 12:02:06:470 IBC: Click button: OK ib-gateway-1 | 2024-08-21 12:02:06:663 IBC: detected dialog entitled: Pending Tasks; event=Closed ib-gateway-1 | 2024-08-21 12:02:06:664 IBC: detected dialog entitled: IBKR Gateway; event=Activated ib-gateway-1 | 2024-08-21 12:02:06:667 IBC: detected dialog entitled: IBKR Gateway; event=Focused ib-gateway-1 | 2024-08-21 12:02:06:668 IBC: detected dialog entitled: IBKR Gateway; event=Opened ib-gateway-1 | 2024-08-21 12:02:06:669 IBC: Click button: OK ib-gateway-1 | 2024-08-21 12:02:06:776 IBC: detected dialog entitled: IBKR Gateway; event=Lost focus ib-gateway-1 | 2024-08-21 12:02:06:778 IBC: detected dialog entitled: IBKR Gateway; event=Deactivated ib-gateway-1 | 2024-08-21 12:02:06:780 IBC: detected dialog entitled: IBKR Gateway; event=Closed ib-gateway-1 | 2024-08-21 12:02:06:781 IBC: detected dialog entitled: DU9160780 Trader Workstation Configuration (Simulated Trading); event=Closed ib-gateway-1 | remove Client 0 ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-AsyncNonLocked-43" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-euhmdsDispatcherS10-28817S10-28818" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-secdefilListenerS6-75" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-ushmdsListenerS5-72" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-secdefilServicePingS6-88" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-CCPListenerS3-26" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-usfarmServicePingS4-89" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-ushmdsDispatcherS5-73S5-74" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-ushmdsServicePingS5-87" ib-gateway-1 | ib-gateway-1 | Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "JTS-usfarmDispatcherS4-60S4-61" ib-gateway-1 | 2024-08-21 14:16:10,003 JTS-Clock-40 ERROR An exception occurred processing Appender e org.apache.logging.log4j.core.appender.AppenderLoggingException: java.lang.OutOfMemoryError: Java heap space ib-gateway-1 | at org.apache.logging.log4j.core.config.AppenderControl.tryCallAppender(AppenderControl.java:165) ib-gateway-1 | at org.apache.logging.log4j.core.config.AppenderControl.callAppender0(AppenderControl.java:134) ib-gateway-1 | at org.apache.logging.log4j.core.config.AppenderControl.callAppenderPreventRecursion(AppenderControl.java:125) ib-gateway-1 | at org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:89) ib-gateway-1 | at org.apache.logging.log4j.core.config.LoggerConfig.callAppenders(LoggerConfig.java:542) ib-gateway-1 | at org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:500) ib-gateway-1 | at org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:483) ib-gateway-1 | at org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417) ib-gateway-1 | at org.apache.logging.log4j.core.config.AwaitCompletionReliabilityStrategy.log(AwaitCompletionReliabilityStrategy.java:82) ib-gateway-1 | at org.apache.logging.log4j.core.Logger.log(Logger.java:161) ib-gateway-1 | at org.apache.logging.log4j.spi.AbstractLogger.tryLogMessage(AbstractLogger.java:2205) ib-gateway-1 | at org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2159) ib-gateway-1 | at org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2142) ib-gateway-1 | at org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2017) ib-gateway-1 | at org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1983) ib-gateway-1 | at org.apache.logging.log4j.spi.AbstractLogger.info(AbstractLogger.java:1320) ib-gateway-1 | at twslaunch.jutils.aM.t(aM.java:441) ib-gateway-1 | at twslaunch.jutils.aM.u(aM.java:108) ib-gateway-1 | at twslaunch.jutils.aK.run(aK.java:143) ib-gateway-1 | Caused by: java.lang.OutOfMemoryError: Java heap space `

Versions

• OS: Ubuntu
• Docker version 24.0.7, build 24.0.7-0ubuntu4
• Image: gnzsnz/ib-gateway:latest
• Image Digest: sha256:80083540e2e08bd2095a6c43a387057d15d5bd81911298ec0f16ddc2ac328ddd

[gnzsnz]

Please try with the Java heap setting, #51