Kong / galileo-agent-node

Node.js agent for Galileo - API Analytics
https://getgalileo.io
MIT License
9 stars 4 forks source link

Offline buffering #6

Closed kennethklee closed 9 years ago

kennethklee commented 9 years ago

If something catastrophic happens, the agent needs to buffer outgoing data somewhere before sending it out again.

Perhaps we can create records on disk? Then, limit the size to a certain amount so we don't overwhelm the api server.

ahmadnassri commented 9 years ago

one of the requirements / ideas for the agent is to write to log files (with a system level log rotator) so that it does not overwhelm connections on the server ...

this could be a mode of operation or fallback in the case of offline / disconnection.

the logs can then be transferred over in batch ... (log aggregation)

this is also useful for proxy agents as you wouldn't expect a proxy to open as and manage our connections while managing the api connections ...

proxy > logs > batch agent

ahmadnassri commented 9 years ago

moving to https://github.com/Mashape/analytics-agent-spec/issues/3