See comments from this issue for details about the implementation choice of InfluxDB.
I looked for the 2 endpoints referred in the issue 298RecordActivityTaskHeartbeat and PollForActivityTask, and implement a method inside swf/core.py to send statistic to InfluxDB.
This library is used to talk to InfluxDB backend, I assume this part of the code would be non blocking and should not impact the simpleflow behavior, because UDP do not except any answer from the server.
Maybe we should use some AWS tag instead of the worker hostname (not human friendly)
Maybe we should pay attention if the worker would not be able to resolve the grafana fqdn.
Authentication and encryption :
The UDP listener on InfluxDB server doesn't seems to support this, a solutions could consist in writing to a Telegraf proxy agent wich would send the data to Influx over HTTPS.
Or use a local database in the same network.
Test environment/Test case
Considerations for Deployment
In order to implement this solution, the InfluxDB server would have to be setup and the environment secured.
Description
See comments from this issue for details about the implementation choice of InfluxDB.
I looked for the 2 endpoints referred in the issue 298
RecordActivityTaskHeartbeatandPollForActivityTask, and implement a method insideswf/core.pyto send statistic to InfluxDB.I define the tags
regionendpointandhostname.Considerations for Reviewers
This library is used to talk to InfluxDB backend, I assume this part of the code would be non blocking and should not impact the simpleflow behavior, because UDP do not except any answer from the server.
Maybe we should use some AWS tag instead of the worker hostname (not human friendly)
Maybe we should pay attention if the worker would not be able to resolve the grafana fqdn.
Authentication and encryption :
The UDP listener on InfluxDB server doesn't seems to support this, a solutions could consist in writing to a Telegraf proxy agent wich would send the data to Influx over HTTPS. Or use a local database in the same network.
Test environment/Test case
Considerations for Deployment
In order to implement this solution, the InfluxDB server would have to be setup and the environment secured.