search

janmg / logstash-input-azure_blob_storage

This is a plugin for Logstash to fetch files from Azure Storage Accounts
Other
29 stars 8 forks source link

Plugin input is not parsing through CSV properly #23

Closed adhiraj-g closed 2 years ago

adhiraj-g commented 2 years ago

Hi @janmg ,

I am trying to fetch a CSV file from storage account. How does this plugin parse through a csv file. As the logstash filter is only parsing the header and not the rest of the rows. Also, the whole csv is being passed in the message field. Can you please help me out?

input { azure_blob_storage { storageaccount => "storagename" access_key => "" container => "container name" path_filters => ['*/.csv'] addfilename => true

registry_create_policy -=> "start_fresh"

} } filter { csv { separator => "," skip_header => "true" columns => ["head","sales","team"........]

source => "message"

} }