dalmatinerdb / ddb_proxy

Proxy for other metric protocols
MIT License
9 stars 5 forks source link

Wrinting ~15k/sec metrics graphite 2003 tcp getting unexpected EOF #19

Open nokernel opened 7 years ago

nokernel commented 7 years ago

Hello there,

I am getting some dropped TCP sessions on the graphite sender to dalmatiner proxy.

And some metrics never get to the dalmatiner DB.

Here is one interesting debug line for the proxy that is receiving the graphite data.

2017-04-11 13:58:48.545 [error] emulator Error in process <0.12581.7> on node 'ddb_proxy@127.0.0.1' with exit value:
{badarg,[{erlang,binary_to_integer,[<<"nan">>],[]},{dp_decoder,to_number,1,[{file,"/dalmatiner/ddb_proxy/_build/default/lib/dp_decoder/src/dp_decoder.erl"},{line,40}]},{dp_graphite,parse_time,3,[{file,"/dalmatiner/ddb_proxy/_build/default/lib/dp_decoder/src/dp_graphite.erl"},{line,91}]},{dp_line_proto,decode_metrics,2,[{file,"/dalmatiner/ddb_proxy/_build/prod/lib/ddb_proxy/src/dp_line_proto.erl"},{line,20}]},{dp_line_proto,fold_lines,3,[{file,"/dalmatiner/ddb_proxy/_build/prod/lib/ddb_proxy/src/dp_line_proto.erl"},{line,12}]},{dp_tcp_listener,loop,4,[{file,"/dalmatiner/ddb_proxy/_build/prod/lib/ddb_proxy/src/dp_tcp_listener.erl"},{line,22}]}]}

The result is a terminated TCP session on the graphite sender. Frankly I might need some hints so I can provide a better report.