Docker: pcap-log max-files limit is not working on Ubuntu 22.04 LTS

[michal25]

This configuration

Is not working on Ubuntu 22.04.2 LTS (GNU/Linux 5.15.0-72-generic x86_64) (not selks image, normal Ubuntu virtual OS).

Description root@suricata:~# docker exec suricata suricata --build-info This is Suricata version 7.0.0-rc2-dev (afef35b9d 2023-05-24) Features: NFQ PCAP_SET_BUFF AF_PACKET HAVE_PACKET_FANOUT LIBCAP_NG LIBNET1.1 HAVE_HTP_URI_NORMALIZE_HOOK PCRE_JIT HAVE_NSS HTTP2_DECOMPRESSION HAVE_LUA HAVE_LIBJANSSON TLS TLS_C11 MAGIC RUST SIMD support: SSE_4_2 SSE_4_1 SSE_3 Atomic intrinsics: 1 2 4 8 16 byte(s) 64-bits, Little-endian architecture GCC version 11.3.1 20221121 (Red Hat 11.3.1-4), C version 201112 compiled with _FORTIFY_SOURCE=0 L1 cache line size (CLS)=64 thread local storage method: _Thread_local compiled with LibHTP v0.5.43, linked against LibHTP v0.5.43

Suricata Configuration: AF_PACKET support: yes AF_XDP support: no DPDK support: yes eBPF support: yes XDP support: yes PF_RING support: no NFQueue support: yes NFLOG support: no IPFW support: no Netmap support: no DAG enabled: no Napatech enabled: no WinDivert enabled: no

Unix socket enabled: yes Detection enabled: yes

Libmagic support: yes libjansson support: yes hiredis support: yes hiredis async with libevent: yes PCRE jit: yes LUA support: yes libluajit: no GeoIP2 support: yes Non-bundled htp: no Hyperscan support: yes Libnet support: yes liblz4 support: yes Landlock support: yes

Rust support: yes Rust strict mode: no Rust compiler path: /usr/bin/rustc Rust compiler version: rustc 1.66.1 (90743e729 2023-01-10) (Red Hat 1.66.1-1.el9) Cargo path: /usr/bin/cargo Cargo version: cargo 1.66.1

Python support: yes Python path: /usr/bin/python3 Install suricatactl: yes Install suricatasc: yes Install suricata-update: yes

Profiling enabled: no Profiling locks enabled: no Profiling rules enabled: no

Plugin support (experimental): yes

Development settings: Coccinelle / spatch: no Unit tests enabled: no Debug output enabled: no Debug validation enabled: no Fuzz targets enabled: no

Generic build parameters: Installation prefix: /usr Configuration directory: /etc/suricata/ Log directory: /var/log/suricata/

--prefix /usr --sysconfdir /etc --localstatedir /var --datarootdir /usr/share

Host: x86_64-pc-linux-gnu Compiler: gcc (exec name) / g++ (real) GCC Protect enabled: no GCC march native enabled: no GCC Profile enabled: no Position Independent Executable enabled: no CFLAGS -g -O2 -fPIC -std=c11 -I/usr/include/dpdk -include rte_config.h -march=corei7 -I${srcdir}/../rust/gen -I${srcdir}/../rust/dist PCAP_CFLAGS
SECCFLAGS

Steps to reproduce the issue:

1. Install normal Ubuntu 22.04 LTS 64bit server version as virtual machine
2. Install SELKS 7 via docker: https://github.com/StamusNetworks/SELKS/wiki/Docker#understanding-the-setup-script
3. pcap-log max-files limit is not working and the disk will be filled with pcap files

[pevma]

Can you please share the output of the max-files in the yaml settings you have setup ? Also ls -lh of the pcap folder where they are stored if ok please?
You can also have a look at the log rotation settings here just in case - https://github.com/StamusNetworks/SELKS/wiki/Docker#log-rotation , by default it is daily. Does it fill up too fast within 24hrs or just not rotating actually ?

[michal25]

  - pcap-log:
      enabled: yes
      filename: log.%n.%t.pcap
      #filename: log.pcap

      # File size limit.  Can be specified in kb, mb, gb.  Just a number
      # is parsed as bytes.
      limit: 20mb

      # If set to a value will enable ring buffer mode. Will keep Maximum of "max-files" of size "limit"
      max-files: 8000

      mode: multi # normal, multi or sguil.

      # Directory to place pcap files. If not provided the default log
      # directory will be used. Required for "sguil" mode.
      dir: /var/log/suricata/fpc/

ls -lh looks ok It looks as it fill up too fast within 24hrs.

[pevma]

ok so if it is filling up to fast maybe you can adjust the rotation to hourly as per the link above?