search

fluent / fluent-bit-docker-image

Docker image for Fluent Bit
https://hub.docker.com/r/fluent/fluent-bit/
Apache License 2.0
67 stars 75 forks source link

docker imges don't have journald support #5

Closed jenningsloy318 closed 7 years ago

jenningsloy318 commented 7 years ago

This 0.12-dev Dockfile don't install libsystemd-dev, thus images don't have journald support.

consider add libsystemd-dev

marcbachmann commented 7 years ago

Even after installing libsystemd-dev, I get a segfault without any error message when running fluent-bit.

$ apt-get install libsystemd-dev
$ /fluent-bit/bin/fluent-bit -c /fluent-bit/etc/fluent-bit.conf
Fluent-Bit v0.12.0
Copyright (C) Treasure Data

[2017/08/10 14:30:51] [ info] [engine] started
[2017/08/10 14:30:51] [debug] [router] match rule cpu.0:stdout.0
[2017/08/10 14:30:51] [debug] [router] match rule cpu.0:es.0
[2017/08/10 14:30:51] [debug] [input cpu.0] [mem buf] size = 317
[2017/08/10 14:30:52] [debug] [task->buffer] worker_id=0
[2017/08/10 14:30:52] [debug] [task] created task=0x7f1cf4299000 id=0 OK
[0] my_cpu: [1502375452.000218475, {"cpu_p"=>0.000000, "user_p"=>0.000000, "system_p"=>0.000000, "cpu0.p_cpu"=>0.000000, "cpu0.p_user"=>0.000000, "cpu0.p_system"=>0.000000, "cpu1.p_cpu"=>0.000000, "cpu1.p_user"=>0.000000, "cpu1.p_system"=>0.000000, "cpu2.p_cpu"=>0.000000, "cpu2.p_user"=>0.000000, "cpu2.p_system"=>0.000000, "cpu3.p_cpu"=>0.000000, "cpu3.p_user"=>0.000000, "cpu3.p_system"=>0.000000}]
Segmentation fault (core dumped)
edsiper commented 7 years ago

The 0.12-dev image have systemd:

https://github.com/fluent/fluent-bit-docker-image/blob/master/0.12-dev/Dockerfile#L24

doing a test:

$ docker run -ti fluent/fluent-bit:0.12-dev /usr/bin/dpkg -l|grep systemd
ii  libsystemd0:am 215-17+deb8u amd64        systemd utility library

do you have a custom config ? how can I reproduce the problem ?

marcbachmann commented 7 years ago

Oh, I guess it wasn't related to the journal module. I tried it in combination with the elasticsearch output. It looks like it's the elasticsearch output which is the problem. Here's an example config with a cpu input:

cat > ./fluent-bit.conf << EOF
[INPUT]
    Name  cpu
    Tag   cpu

[OUTPUT]
    Name  es
    Match *
    Host  192.168.2.3
    Port  9200
    Index my_index
    Type  my_type
EOF

docker run -it -v $PWD/fluent-bit.conf:/fluent-bit/etc/fluent-bit.conf --rm fluent/fluent-bit:0.12-dev
edsiper commented 7 years ago

@marcbachmann

thanks. I was able to reproduce the problem (it was introduced in a recent change).

I've pushed the fix and the new Docker image fluent/fluent-bit:0.12-dev is building, it should be ready in about 15 min.

edsiper commented 7 years ago

Issue addressed a while ago. Fixed.