elastic / beats

:tropical_fish: Beats - Lightweight shippers for Elasticsearch & Logstash
https://www.elastic.co/products/beats
Other
108 stars 4.93k forks source link

Filebeat Azure Blob Storate input blobs paths list #35186

Open dimuskin opened 1 year ago

dimuskin commented 1 year ago

FilebeatAzure Blob Storate input (https://www.elastic.co/guide/en/beats/filebeat/master/filebeat-input-azure-blob-storage.html) allows you to import data into Elastic, but unfortunately there is no way to do blobs filtering before they are downloaded. It is possible to download the data first and do processing by the processor on the filebeat side, but this makes a crazy load if the storage contains a large amount of data, and we only need a small part.

elasticmachine commented 1 year ago

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

elasticmachine commented 9 months ago

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)