search

gerritjvv / bigstreams

bigstreams big data kafka hadoop and file based imports
Eclipse Public License 1.0
3 stars 3 forks source link

CoordinationServiceSaveAgentSendHistory #45

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
Coordination Service should save the agent send history.

Remember that the coordination service is a distributed service such that all 
information should be shared distributed.
This information can be stored in a distributed map with backup == 1. 

We need to know:
  Agent -- last time contacted (timestamp per file)
  Agent -- send information:
       Keep history information:
       Size of message (we know this from comparing the last file pointer sent)
       Collector it sent to.(we know this from the cremoteAddress:InetSocketAddress in the coordination service CoordinationLockHandler)

Items todo:
  (1) Update CollectorFileTrackerMemory such that it contains a history part.
  (2) Update HazelcastFileTrackerStorage that is implements CollectorFileTrackerMemory

  (3) Test Resources

Original issue reported on code.google.com by gerritjvv@gmail.com on 25 Apr 2011 at 7:18

GoogleCodeExporter commented 8 years ago

Original comment by gerritjvv@gmail.com on 13 Jun 2011 at 4:21