See comments from this issue for details about the implementation choice of InfluxDB.
I looked for the 2 endpoints referred in the issue 298RecordActivityTaskHeartbeat and PollForActivityTask, and implement a method inside swf/core.py to send statistic to InfluxDB.
This library is used to talk to InfluxDB backend, I assume this part of the code would be non blocking and should not impact the simpleflow behavior, because UDP do not except any answer from the server.
Maybe we should use some AWS tag instead of the worker hostname (not human friendly).
Authentication and encryption :
The UDP listener on InfluxDB server doesn't seems to support this, a solutions could consist in writing to a Telegraf proxy agent wich would send the data to Influx over HTTPS.
Or use a local database in the same network.
Description
See comments from this issue for details about the implementation choice of InfluxDB.
I looked for the 2 endpoints referred in the issue 298
RecordActivityTaskHeartbeat
andPollForActivityTask
, and implement a method insideswf/core.py
to send statistic to InfluxDB.I defined the tags
region
endpoint
andhostname
.Considerations for Reviewers
This library is used to talk to InfluxDB backend, I assume this part of the code would be non blocking and should not impact the simpleflow behavior, because UDP do not except any answer from the server.
Maybe we should use some AWS tag instead of the worker hostname (not human friendly).
Authentication and encryption :
The UDP listener on InfluxDB server doesn't seems to support this, a solutions could consist in writing to a Telegraf proxy agent wich would send the data to Influx over HTTPS. Or use a local database in the same network.