search

Azure / azure-diagnostics-tools

Plugins and tools for collecting, processing, managing, and visualizing diagnostics data and configuration
98 stars 92 forks source link

[logstash-input-azureblob] Ingesting access log data from $logs #184

Open 01100010011001010110010101110000 opened 5 years ago

01100010011001010110010101110000 commented 5 years ago

Ingesting storage account access logs from the $logs container created by enabling storage access logs seems to be impossible, as that container is not writable and the plugin relies on writing its registry file into the container.

Bafff commented 5 years ago

Hi all Any news about this problem?

How can I make it work with $logs container?

01100010011001010110010101110000 commented 5 years ago

@Bafff FYI what we ended up doing is using Azure Data Factory to ship the logs from $logs in all our storage accounts to a central storage account, then having logstash pick them up from there

Bafff commented 5 years ago

@01100010011001010110010101110000 and at the end are you using azureblob input from ADF?

NareshAnaparthi commented 4 years ago

container => "$logs" .. as $ is special character, having difficulty in constructing URI and getting Permission issue https://xxxxxblob.core.windows.net/%24logs/ Could some one shed some light on handling $logs container logs