OpenTSDB / opentsdb

A scalable, distributed Time Series Database.
http://opentsdb.net
GNU Lesser General Public License v2.1
5k stars 1.25k forks source link

Load uid very slowly #2276

Open zhoujian1996 opened 1 year ago

zhoujian1996 commented 1 year ago

Hi, everyOne,My project use flink handle too many kafka record. Every time, we restart the flink job, it may load too many uid from the hbase,so it makes consume the records very slowly。 SomeBody may give us some advice faster the restart process? Thanks!

mindflying commented 1 year ago

写入到hbase的时候,从name_cache或者id_cache dump到本地文件 重启flink的时候,直接从文件加载撒

zhoujian1996 commented 1 year ago

好的,我们按照这种方式试下。有个问题请教下:opentsdb好像无法感知到hbase端regionServer的变化导致一直向错误的regionServer导入大量流量,这种你们有遇见过吗?