This PR adds the ability to configure various values related to collecting data from Azure. These configuration options are not required to be set in the config file and will use a reasonable default if not set. Allowing these values to be easily configured can help to improve collection times or troubleshoot issues with collection.
The newly added options are:
batchSize
maxConnsPerHost
maxIdleConnsPerHost
streamCount
To configure them, simply add a new attribute to the config.json file with one of the names above. Here's an example:
Also, the default values for each of these values have been adjusted to hopefully give better performance. Testing has shown that these new defaults provide better collection times, less timeouts, and better memory management in large environments.
Lastly, the new configuration options have built-in sanity checks to prevent setting to harmful values. If the option is found to be set outside of the defined bounds it will revert to the default value.
This PR adds the ability to configure various values related to collecting data from Azure. These configuration options are not required to be set in the config file and will use a reasonable default if not set. Allowing these values to be easily configured can help to improve collection times or troubleshoot issues with collection.
The newly added options are:
batchSize
maxConnsPerHost
maxIdleConnsPerHost
streamCount
To configure them, simply add a new attribute to the
config.json
file with one of the names above. Here's an example:Also, the default values for each of these values have been adjusted to hopefully give better performance. Testing has shown that these new defaults provide better collection times, less timeouts, and better memory management in large environments.
Lastly, the new configuration options have built-in sanity checks to prevent setting to harmful values. If the option is found to be set outside of the defined bounds it will revert to the default value.