Multi file scraping - Githubissues

trivago / gollum

An n:m message multiplexer written in Go

http://gollum.readthedocs.org/en/latest/

Apache License 2.0

940 stars 74 forks source link

Multi file scraping #232

Closed arnecls closed 6 years ago

arnecls commented 6 years ago

The purpose of this pull request

Extend consumer.File to allow parsing multiple files at the same time by using glob patterns. This introduces breaking changes.

Config to verify

logFilesIn:
    Type: consumer.File
    Streams: logs
    Files: "/var/log/*.log"

logFilesOut:
    Type: producer.Console
    Streams: logs

Checklist

[x] make test executed successfully
[x] integration test provided
[x] docs updated

coveralls commented 6 years ago

Coverage decreased (-0.04%) to 71.474% when pulling df2476721922adb42cbd543717ddd142e983a0be on multiFileScraping into 17972631fc322731e3eadc4c7e3dc35be5436c0c on master.