I'm using the AzureBlob module for NSG Flow Logs. After reading some issues, I saw that there are some specific issues due to the number of JSON which could be managed by the module and due to the way the registry is managed.
My first question is: is there any way to monitor the registry and the number of blob which have been read or not? How could I be sure that all blobs have been read by logstash?
On the other hand, the registry file on my side is growing (for now arround 36MB), even if blobs are deleted each day. Do you know if the module should remove automatically all deleted blobs entries in the registry?
I'm using the AzureBlob module for NSG Flow Logs. After reading some issues, I saw that there are some specific issues due to the number of JSON which could be managed by the module and due to the way the registry is managed.
My first question is: is there any way to monitor the registry and the number of blob which have been read or not? How could I be sure that all blobs have been read by logstash?
On the other hand, the registry file on my side is growing (for now arround 36MB), even if blobs are deleted each day. Do you know if the module should remove automatically all deleted blobs entries in the registry?