search

IceWhaleTech / CasaOS

CasaOS - A simple, easy-to-use, elegant open-source Personal Cloud system.
https://casaos.io
Apache License 2.0
25.34k stars 1.37k forks source link

[Bug] Logfiles are > 20GB and growing #1630

Open johnbbbbbb opened 8 months ago

johnbbbbbb commented 8 months ago

Describe the bug

/var/log/syslog is more than 10GB and making more of itself as syslog.1 :

image

This is a snippet of the output of cat /var/log/syslog, the same message is repeated millions of times:

Jan 14 00:12:05 mediabox casaos-message-bus[1064]: {"time":"2024-01-14T00:12:05.058496723Z","id":"","remote_ip":"127.0.0.1","host":"127.0.0.1:34907","method":"POST","uri":"/v2/message_bus/event/casaos/casaos:file:operate","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":1004557,"latency_human":"1.004557ms","bytes_in":53,"bytes_out":199}
Jan 14 00:12:05 mediabox casaos-message-bus[1064]: {"time":"2024-01-14T00:12:05.063754991Z","id":"","remote_ip":"127.0.0.1","host":"127.0.0.1:34907","method":"POST","uri":"/v2/message_bus/event/casaos/casaos:file:operate","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":1072300,"latency_human":"1.0723ms","bytes_in":53,"bytes_out":199}
Jan 14 00:12:05 mediabox casaos-message-bus[1064]: {"time":"2024-01-14T00:12:05.091245478Z","id":"","remote_ip":"127.0.0.1","host":"127.0.0.1:34907","method":"POST","uri":"/v2/message_bus/event/casaos/casaos:file:operate","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":1135436,"latency_human":"1.135436ms","bytes_in":53,"bytes_out":199}
Jan 14 00:12:05 mediabox casaos-message-bus[1064]: {"time":"2024-01-14T00:12:05.096351471Z","id":"","remote_ip":"127.0.0.1","host":"127.0.0.1:34907","method":"POST","uri":"/v2/message_bus/event/casaos/casaos:file:operate","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":1054007,"latency_human":"1.054007ms","bytes_in":53,"bytes_out":199}
Jan 14 00:12:05 mediabox casaos-message-bus[1064]: {"time":"2024-01-14T00:12:05.105363702Z","id":"","remote_ip":"127.0.0.1","host":"127.0.0.1:34907","method":"POST","uri":"/v2/message_bus/event/casaos/casaos:file:operate","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":1096179,"latency_human":"1.096179ms","bytes_in":53,"bytes_out":199}
Jan 14 00:12:05 mediabox casaos-message-bus[1064]: {"time":"2024-01-14T00:12:05.108235993Z","id":"","remote_ip":"127.0.0.1","host":"127.0.0.1:34907","method":"POST","uri":"/v2/message_bus/event/casaos/casaos:file:operate","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":1023527,"latency_human":"1.023527ms","bytes_in":53,"bytes_out":199}
Jan 14 00:12:05 mediabox casaos-message-bus[1064]: {"time":"2024-01-14T00:12:05.175599477Z","id":"","remote_ip":"127.0.0.1","host":"127.0.0.1:34907","method":"POST","uri":"/v2/message_bus/event/casaos/casaos:file:operate","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":1211002,"latency_human":"1.211002ms","bytes_in":53,"bytes_out":199}

I am soon running out of space - is there anything I can do to fix this?

Desktop:

 - OS: Ubuntu Server 22.04
 - Browser N/C
 - CasaOS Version 0.4.4.2

System Time

               Local time: Sat 2024-01-20 16:34:03 UTC
           Universal time: Sat 2024-01-20 16:34:03 UTC
                 RTC time: Sat 2024-01-20 16:34:03
                Time zone: Etc/UTC (UTC, +0000)
System clock synchronized: yes
              NTP service: active
          RTC in local TZ: no

Logs casaos.zip

GregPK commented 5 months ago

Have a similar issue. Log files were >16GB and growing, mostly syslog (with gzipped archives as well) deamon.log and journal/*. I saw nothing special in the logs, here's a sample:

May  7 15:11:37 CasaOS casaos[842]: /bin/bash -c source /usr/share/casaos/shell/helper.sh ;CatNetCardState enp2s0
May  7 15:11:37 CasaOS casaos[842]: /bin/bash -c source /usr/share/casaos/shell/helper.sh ;CatNetCardState enp3s0
May  7 15:11:37 CasaOS casaos-message-bus[825]: {"time":"2024-05-07T15:11:37.053400847-04:00","id":"","remote_ip":"127.0.0.1","host":"127.0.0.1:41733","method":"POST","uri":"/v2/message_bus/event/casaos/casaos:system:utilization","user_agent":"Go-http-client/1.1","status":200,"error":"","latency":1193496,"latency_human":"1.193496ms","bytes_in":837,"bytes_out":994}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.400-0400#011info#011app not found in any appstore#011{"id": "syncthing_old_old_old", "func": "service.(*AppStoreManagement).ComposeApp", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/appstore_management.go", "line": 390}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.400-0400#011info#011Using default appstore#011{"func": "service.(*AppStoreManagement).ComposeApp", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/appstore_management.go", "line": 397}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.400-0400#011error#011store compose app not found, thus no update available#011{"storeAppID": "syncthing_old_old_old", "func": "service.(*ComposeApp).IsUpdateAvailable", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/compose_app.go", "line": 186}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.408-0400#011error#011extension `x-casaos` not found#011{"func": "service.(*App).StoreInfo", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/app.go", "line": 18}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.409-0400#011info#011app not found in any appstore#011{"id": "exciting_gregoire", "func": "service.(*AppStoreManagement).ComposeApp", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/appstore_management.go", "line": 390}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.409-0400#011info#011Using default appstore#011{"func": "service.(*AppStoreManagement).ComposeApp", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/appstore_management.go", "line": 397}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.409-0400#011error#011store compose app not found, thus no update available#011{"storeAppID": "exciting_gregoire", "func": "service.(*ComposeApp).IsUpdateAvailable", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/compose_app.go", "line": 186}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.417-0400#011error#011extension `x-casaos` not found#011{"func": "service.(*App).StoreInfo", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/app.go", "line": 18}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.417-0400#011info#011app not found in any appstore#011{"id": "gifted_wayne", "func": "service.(*AppStoreManagement).ComposeApp", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/appstore_management.go", "line": 390}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.417-0400#011info#011Using default appstore#011{"func": "service.(*AppStoreManagement).ComposeApp", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/appstore_management.go", "line": 397}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.417-0400#011error#011store compose app not found, thus no update available#011{"storeAppID": "gifted_wayne", "func": "service.(*ComposeApp).IsUpdateAvailable", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/compose_app.go", "line": 186}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.426-0400#011info#011main apps of local app and store app have different image tag, thus update is available#011{"local": "linuxserver/plex:1.32.8", "store": "linuxserver/plex:1.40.1", "func": "service.(*ComposeApp).IsUpdateAvailableWith", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/compose_app.go", "line": 273}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.435-0400#011info#011main apps of local app and store app have different image tag, thus update is available#011{"local": "hotio/qbittorrent:release-4.5.2", "store": "hotio/qbittorrent:release-4.6.2", "func": "service.(*ComposeApp).IsUpdateAvailableWith", "file": "/home/runner/work/CasaOS-AppManagement/CasaOS-AppManagement/service/compose_app.go", "line": 273}
May  7 15:11:37 CasaOS casaos-app-management[3671]: 2024-05-07T15:11:37.443-0400#011info#011app not found in any appstore#011{"id": "syncthing_old_old", "func": "service.(*AppStoreM