dvasdekis / ib-gateway-docker-gcp

Leaner and Faster Interactive Brokers Docker Trading Gateway
MIT License
68 stars 19 forks source link

/root/Jts/*encrypted-dir*/ibgateway.date.time.aaa.ibenc logs blow up the disc #7

Closed hedgecheap closed 4 years ago

hedgecheap commented 4 years ago

After 1 week of usage, there is a large amount of logging wasting space:

4.0K    nia2.lck
4.0K    nia2.log
4.0K    nia2.properties
4.0K    nia2.properties.bak
4.0K    nia2.script
4.0K    nia2.script.bak
4.0K    nia2.tmp
4.0M    ibgateway.20200420.193720.aaa.ibenc
6.5M    language.jar
55M     ibgateway.20200420.075025.aaa.ibenc
56M     ibgateway.20200419.232914.aaa.ibenc
57M     ibgateway.20200416.012330.aaa.ibenc
57M     ibgateway.20200416.073235.aaa.ibenc
61M     ibgateway.20200415.191743.aaa.ibenc
61M     ibgateway.20200416.195820.aaa.ibenc
62M     ibgateway.20200417.041947.aaa.ibenc
62M     ibgateway.20200419.164017.aaa.ibenc
63M     ibgateway.20200414.055821.aaa.ibenc
64M     ibgateway.20200415.043744.aaa.ibenc
67M     ibgateway.20200414.185312.aaa.ibenc
83M     ibgateway.20200416.135640.aaa.ibenc
89M     ibgateway.20200415.120932.aaa.ibenc
98M     ibgateway.20200414.132206.aaa.ibenc
101M    ibgateway.20200420.133037.aaa.ibenc
363M    ibgateway.20200417.103500.aaa.ibenc
555M    ibgateway.20200419.075736.aaa.ibenc
1.1G    ibgateway.20200418.155441.aaa.ibenc
1.3G    ibgateway.20200418.001226.aaa.ibenc

So, this is almost a gig of encrypted (and therefore unreadable) logs per day. Yuck!

Path on Google Container-Optimized OS: /mnt/stateful_partition/var/lib/docker/overlay2/*encrypted-name*/diff/root/Jts/

hedgecheap commented 4 years ago

In the above case, the container was up for 2 weeks, but only 5 days of logs were visible. Perhaps there is a cleanup routine after 5 days? Either way, we have to allocate about 20GB extra disk than we think, just fo rlogging

hedgecheap commented 4 years ago

Can confirm that some kind of auto-cleanup is happening. Here's the result 3 days later - note that logs from the 14th and 15th are gone:

drwxr-xr-x 3 root root 4.0K Apr 23 01:35 .
drwxr-xr-x 1 root root 4.0K Apr  2 23:00 ..
-rw-r--r-- 1 root root  57M Apr 16 12:32 ibgateway.20200416.012330.aaa.ibenc
-rw-r--r-- 1 root root  57M Apr 16 18:56 ibgateway.20200416.073235.aaa.ibenc
-rw-r--r-- 1 root root  83M Apr 17 00:57 ibgateway.20200416.135640.aaa.ibenc
-rw-r--r-- 1 root root  61M Apr 17 09:19 ibgateway.20200416.195820.aaa.ibenc
-rw-r--r-- 1 root root  62M Apr 17 15:34 ibgateway.20200417.041947.aaa.ibenc
-rw-r--r-- 1 root root 363M Apr 18 05:11 ibgateway.20200417.103500.aaa.ibenc
-rw-r--r-- 1 root root 1.3G Apr 18 20:54 ibgateway.20200418.001226.aaa.ibenc
-rw-r--r-- 1 root root 1.1G Apr 19 12:56 ibgateway.20200418.155441.aaa.ibenc
-rw-r--r-- 1 root root 555M Apr 19 21:39 ibgateway.20200419.075736.aaa.ibenc
-rw-r--r-- 1 root root  62M Apr 20 04:28 ibgateway.20200419.164017.aaa.ibenc
-rw-r--r-- 1 root root  56M Apr 20 12:50 ibgateway.20200419.232914.aaa.ibenc
-rw-r--r-- 1 root root  55M Apr 20 18:30 ibgateway.20200420.075025.aaa.ibenc
-rw-r--r-- 1 root root 101M Apr 21 00:36 ibgateway.20200420.133037.aaa.ibenc
-rw-r--r-- 1 root root  68M Apr 21 09:01 ibgateway.20200420.193720.aaa.ibenc
-rw-r--r-- 1 root root  62M Apr 21 15:10 ibgateway.20200421.040150.aaa.ibenc
-rw-r--r-- 1 root root  54M Apr 21 21:02 ibgateway.20200421.101115.aaa.ibenc
-rw-r--r-- 1 root root  77M Apr 22 01:22 ibgateway.20200421.160302.aaa.ibenc
-rw-r--r-- 1 root root  61M Apr 22 08:18 ibgateway.20200421.202238.aaa.ibenc
-rw-r--r-- 1 root root  68M Apr 22 14:51 ibgateway.20200422.031846.aaa.ibenc
-rw-r--r-- 1 root root  58M Apr 22 20:50 ibgateway.20200422.095210.aaa.ibenc
-rw-r--r-- 1 root root  70M Apr 23 01:35 ibgateway.20200422.155121.aaa.ibenc
-rw-r--r-- 1 root root 2.4M Apr 23 02:13 ibgateway.20200422.203528.aaa.ibenc
-rw-r--r-- 1 root root 6.5M Apr 16 16:19 language.jar
-rw-r--r-- 1 root root   16 Apr 23 02:13 nia2.lck
-rw-r--r-- 1 root root  160 Apr 23 01:35 nia2.log
-rw-r--r-- 1 root root  100 Apr 23 01:35 nia2.properties
-rw-r--r-- 1 root root  100 Apr 23 01:35 nia2.properties.bak
-rw-r--r-- 1 root root 3.4K Apr 23 01:35 nia2.script
-rw-r--r-- 1 root root 3.4K Apr 23 01:35 nia2.script.bak
drwxr-xr-x 2 root root 4.0K Apr  2 23:00 nia2.tmp