Closed cmacknz closed 2 years ago
@fearful-symmetry I believe the work remaining here is to use a config transformation to automatically add the metadata add_fields
processors from https://github.com/elastic/elastic-agent/pull/527 to each of the Beats on the v2 feature branch.
@cmacknz A little confused here. The processors should all be added on the beats side, are you talking about importing them into the shipper?
This issue was created before we had any of the v2 implementation in Beats. You are correct that the remaining work should happen in Beats, this issue will be transferred to the Beats repository.
Synced up with Alex, this has already been taken care of. Closing.
To quickly allow metricbeat and filebeat to integrate with the shipper the stream identifiers (data stream and input ID) needed to allow the shipper to map events to processors are being injected via the
inject_stream_processor
specification file transformation. See the implementation in https://github.com/elastic/elastic-agent/pull/527.In the V2 agent specification file format the agent will no longer be able automatically transform sections of the agent policy into a beat configuration file. All inputs must know how to configure themselves to run under agent automatically.
Define and implement a way of providing the needed stream identifiers to agent inputs without relying on specification file transformations as required by the V2 specification file format. This includes all beats (not just filebeat and metricbeat) and non-beat agent inputs like endpoint security.
Ideally the beats can consume the agent policy sections containing the relevant information directly without transformation, and instantiate the necessary processors automatically. This is similar to the approach heartbeat currently uses, see the heartbeat specification file and heartbeat code adding the processors.
Relates To:
This task is considered complete when: