Need to instrument messages so that useful shipper dashboards can be created.
Each message should include information about:
The message source (@source.host, @source.path, @source.service etc etc)
The shipper (@shipper.host, @shipper.path, @shipper.shipped_at etc etc)
The ingestor (@ingestor.host, @ingestor.type, @ingestor.ingested_at etc etc)
The parser (@parser.host, @parser.parsed_at etc etc)
The dashboards should show things like rate of shipping; time spent at each stage, etc, and give a general overview as to the health of the shipping & ingesting process
Need to instrument messages so that useful shipper dashboards can be created.
Each message should include information about:
@source.host
,@source.path
,@source.service
etc etc)@shipper.host
,@shipper.path
,@shipper.shipped_at
etc etc)@ingestor.host
,@ingestor.type
,@ingestor.ingested_at
etc etc)@parser.host
,@parser.parsed_at
etc etc)The dashboards should show things like rate of shipping; time spent at each stage, etc, and give a general overview as to the health of the shipping & ingesting process