[db][kairosdb] Invalid json. No content due to end of input

at15 commented 6 years ago

this error didn't show up when running test using libtsdb
points are still written into kairosdb, we can read it in the web ui
[ ] it could be we are not setting content type correctly
[ ] not draining connection? close body?

WARN 0009 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
WARN 0009 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
WARN 0009 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}

cassandra_1  | WARN  [Native-Transport-Requests-12] 2018-03-05 23:58:42,775 BatchStatement.java:301 - Batch for [kairosdb.data_points] is of size 5.469KiB, exceeding specified threshold of 5.000KiB by 0.469KiB.

at15 commented 6 years ago

the points are in for sure ...

at15 commented 6 years ago

yeah our encoder is having problem ...

 [{"name":"xbw0.series.929.0","timestamp":1520295757928,"value":12.3,"tags":{"key9290":"val9290"}},

DEBU 0001 400 [{"name":"xbw0.series.929.0","timestamp":1520295757928,"value":12.3,"tags":{"key9290":"val9290"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.672.0","timestamp":1520295757945,"value":12.3,"tags":{"key6720":"val6720"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.950.0","timestamp":1520295757901,"value":12.3,"tags":{"key9500":"val9500"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.89.0","timestamp":1520295757858,"value":12.3,"tags":{"key890":"val890"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.752.0","timestamp":1520295757878,"value":12.3,"tags":{"key7520":"val7520"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.278.0","timestamp":1520295757845,"value":12.3,"tags":{"key2780":"val2780"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.976.0","timestamp":1520295757860,"value":12.3,"tags":{"key9760":"val9760"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.950.0","timestamp":1520295757902,"value":12.3,"tags":{"key9500":"val9500"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.89.0","timestamp":1520295757859,"value":12.3,"tags":{"key890":"val890"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.752.0","timestamp":1520295757879,"value":12.3,"tags":{"key7520":"val7520"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.278.0","timestamp":1520295757846,"value":12.3,"tags":{"key2780":"val2780"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.976.0","timestamp":1520295757861,"value":12.3,"tags":{"key9760":"val9760"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.950.0","timestamp":1520295757903,"value":12.3,"tags":{"key9500":"val9500"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.950.0","timestamp":1520295757904,"value":12.3,"tags":{"key9500":"val9500"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.752.0","timestamp":1520295757880,"value":12.3,"tags":{"key7520":"val7520"}},
DEBU 0001 400 [{"name":"xbw0.series.672.0","timestamp":1520295757946,"value":12.3,"tags":{"key6720":"val6720"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.976.0","timestamp":1520295757862,"value":12.3,"tags":{"key9760":"val9760"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.929.0","timestamp":1520295757929,"value":12.3,"tags":{"key9290":"val9290"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.89.0","timestamp":1520295757860,"value":12.3,"tags":{"key890":"val890"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.198.0","timestamp":1520295757986,"value":12.3,"tags":{"key1980":"val1980"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.807.0","timestamp":1520295757919,"value":12.3,"tags":{"key8070":"val8070"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.278.0","timestamp":1520295757847,"value":12.3,"tags":{"key2780":"val2780"}},
DEBU 0001 400 [{"name":"xbw0.series.744.0","timestamp":1520295757990,"value":12.3,"tags":{"key7440":"val7440"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.198.0","timestamp":1520295757987,"value":12.3,"tags":{"key1980":"val1980"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.89.0","timestamp":1520295757861,"value":12.3,"tags":{"key890":"val890"}},
DEBU 0001 400 [{"name":"xbw0.series.752.0","timestamp":1520295757881,"value":12.3,"tags":{"key7520":"val7520"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.950.0","timestamp":1520295757905,"value":12.3,"tags":{"key9500":"val9500"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.672.0","timestamp":1520295757947,"value":12.3,"tags":{"key6720":"val6720"}},
DEBU 0001 400 [{"name":"xbw0.series.976.0","timestamp":1520295757863,"value":12.3,"tags":{"key9760":"val9760"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.929.0","timestamp":1520295757930,"value":12.3,"tags":{"key9290":"val9290"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}
DEBU 0001 400 [{"name":"xbw0.series.807.0","timestamp":1520295757920,"value":12.3,"tags":{"key8070":"val8070"}},
WARN 0001 failed to flush {"errors":["Invalid json. No content due to end of input.","Invalid json. No content due to end of input."]}

at15 commented 6 years ago

this should be Kairosdb's problem ...

cassandra_1  | WARN  [Native-Transport-Requests-11] 2018-03-06 00:35:58,526 BatchStatement.java:301 - Batch for [kairosdb.data_points] is of size 5.469KiB, exceeding specified threshold of 5.000KiB by 0.469KiB

xephonhq / xephon-b

[db][kairosdb] Invalid json. No content due to end of input #36