certtools / intelmq

IntelMQ is a solution for IT security teams for collecting and processing security feeds using a message queuing protocol.
https://docs.intelmq.org/latest/
GNU Affero General Public License v3.0
972 stars 295 forks source link

ENH: Added new expert plugin - extra_tags #2474

Closed manuel-subredu closed 6 months ago

manuel-subredu commented 6 months ago

Description

ExtraTags expert plugin aims to ease the testing of an existing pipeline and allow easy routing of the messages in development phase. Main use case:

  1. use extra_tags plugin right after a parser (or input) and mark the messages as beloning to development stage json {'stage': 'dev'}
  2. insert a prod-dev-routing decision right before final output and with filter plugin route non-production messages to various backends to inspection

Testing

(.venv) ➜  intelmq git:(develop) ✗ pytest intelmq/tests/bots/experts/extra_tags -s
=========================================================================================================== test session starts ============================================================================================================
platform darwin -- Python 3.12.0, pytest-8.0.2, pluggy-1.4.0
rootdir: ws/extra-tags/intelmq
configfile: pytest.ini
plugins: cov-4.1.0, requests-mock-1.11.0
collected 5 items

intelmq/tests/bots/experts/extra_tags/test_expert.py ...True
..

---------- coverage: platform darwin, python 3.12.0-final-0 ----------
Coverage XML written to file coverage.xml

============================================================================================================ 5 passed in 2.01s =============================================================================================================
(.venv) ➜  intelmq git:(develop)