search

mchozhang / SinsOnTwitter

4 stars 3 forks source link

Finalise streaming collecting function(multi-thread,self-healing,log,background) #25

Open Arufu opened 5 years ago

Arufu commented 5 years ago
  1. make it run in background.
  2. make it robust: restart after error with a dynamic waiting time, us log file to record events.
  3. long running time test.
  4. improve processing speed: use extra thread to deal with IO to avoid high-data-velocity caused disconnection.
Arufu commented 5 years ago

Tested running for 15 hours: all good.