put data by multi threads or multi clients?

OpenTSDB / opentsdb

A scalable, distributed Time Series Database.

http://opentsdb.net

GNU Lesser General Public License v2.1

5k stars 1.25k forks source link

put data by multi threads or multi clients? #1386

Open psc0606 opened 6 years ago

psc0606 commented 6 years ago

backgroud: About 3.5w points per seconds have to be written to opentsdb, so I aggregates those points in memory and write aggregated results(may still have same points though I have aggregated) to opentsdb by multi clients. How to ensure the same points to be written correctly?
In order to do that, query the point to decide exits whether or not, then accumulate, write at last?

psc0606 commented 6 years ago

@manolama

manolama commented 5 years ago

Depends on you write. If it's via the HTTP API make sure to set the sync flag and it will let you know what results have succeeded or failed. If you're using the JAVA API make sure to attach a callback and it will let you know when it's been committed to storage.